[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:17 dist-test-slave-lzv7 krb5kdc[12934](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:17 dist-test-slave-lzv7 krb5kdc[12934](info): set up 2 sockets
Sep 23 19:35:17 dist-test-slave-lzv7 krb5kdc[12934](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260923 19:35:18.946875 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:19 dist-test-slave-lzv7 krb5kdc[12934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:19.126200 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:39269
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:39269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:19.464699 12947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:19.465075 12947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:19.465243 12947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:19.472676 12947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:19.472836 12947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:19.472954 12947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:19.473055 12947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:19.473131 12947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:19.483192 12947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:39269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:39269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:19.484561 12947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:19.485984 12947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:19.499073 12952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:19.499962 12953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:19.499862 12955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:19.500665 12947 server_base.cc:1034] running on GCE node
I20260923 19:35:19.501535 12947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:19.503110 12947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:19.504347 12947 hybrid_clock.cc:648] HybridClock initialized: now 1790192119504294 us; error 46 us; skew 500 ppm
I20260923 19:35:19.504710 12947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:19 dist-test-slave-lzv7 krb5kdc[12934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192119, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:19.507826 12947 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:19.509366 12947 webserver.cc:460] Webserver started at http://127.12.159.254:36909/ using document root <none> and password file <none>
I20260923 19:35:19.510099 12947 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:19.510218 12947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:19.510470 12947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:19.513443 12947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e"
format_stamp: "Formatted at 2026-09-23 19:35:19 on dist-test-slave-lzv7"
server_key: "bc290c9b78264f0a421ba9db2e07ebf9"
server_key_iv: "77a417c8d4f8dd0b9d66ecb4d47da3d6"
server_key_version: "encryptionkey@0"
I20260923 19:35:19.514214 12947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e"
format_stamp: "Formatted at 2026-09-23 19:35:19 on dist-test-slave-lzv7"
server_key: "bc290c9b78264f0a421ba9db2e07ebf9"
server_key_iv: "77a417c8d4f8dd0b9d66ecb4d47da3d6"
server_key_version: "encryptionkey@0"
I20260923 19:35:19.519382 12947 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:35:19.522969 12962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:19.524315 12947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:35:19.524459 12947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e"
format_stamp: "Formatted at 2026-09-23 19:35:19 on dist-test-slave-lzv7"
server_key: "bc290c9b78264f0a421ba9db2e07ebf9"
server_key_iv: "77a417c8d4f8dd0b9d66ecb4d47da3d6"
server_key_version: "encryptionkey@0"
I20260923 19:35:19.524626 12947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:19.563421 12947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:19.567624 12947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:19.567864 12947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:19.586726 12947 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:39269
I20260923 19:35:19.586732 13013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:39269 every 8 connection(s)
I20260923 19:35:19.588286 12947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:19.592152 13014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:19.593643 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 12947
I20260923 19:35:19.593981 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:19.595877 12927 external_mini_cluster.cc:1428] Setting key 960326b1520c6520683183f1042dc1d3
I20260923 19:35:19.602919 13014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e: Bootstrap starting.
I20260923 19:35:19.605948 13014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:19.606952 13014 log.cc:824] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:19.609913 13014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e: No bootstrap required, opened a new log
I20260923 19:35:19.619319 13014 raft_consensus.cc:348] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39269 } }
I20260923 19:35:19.619825 13014 raft_consensus.cc:374] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:19.619944 13014 raft_consensus.cc:729] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a58d8c6b176e43ce9cce9d3f0c9b2d8e, State: Initialized, Role: FOLLOWER
I20260923 19:35:19.620676 13014 consensus_queue.cc:260] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39269 } }
I20260923 19:35:19.620997 13014 raft_consensus.cc:388] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:19.621157 13014 raft_consensus.cc:482] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:19.621341 13014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:19.623586 13014 raft_consensus.cc:504] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39269 } }
I20260923 19:35:19.624094 13014 leader_election.cc:302] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a58d8c6b176e43ce9cce9d3f0c9b2d8e; no voters:
I20260923 19:35:19.624780 13014 leader_election.cc:288] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:19.624895 13019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 1 FOLLOWER]: Leader election won for term 1
Sep 23 19:35:19 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:19.627056 13019 raft_consensus.cc:686] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [term 1 LEADER]: Becoming Leader. State: Replica: a58d8c6b176e43ce9cce9d3f0c9b2d8e, State: Running, Role: LEADER
I20260923 19:35:19.627475 13014 sys_catalog.cc:564] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:19.627660 13019 consensus_queue.cc:237] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39269 } }
I20260923 19:35:19.631045 13021 sys_catalog.cc:455] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a58d8c6b176e43ce9cce9d3f0c9b2d8e. Latest consensus state: current_term: 1 leader_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39269 } } }
I20260923 19:35:19.631510 13021 sys_catalog.cc:458] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:19.632186 13020 sys_catalog.cc:455] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a58d8c6b176e43ce9cce9d3f0c9b2d8e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39269 } } }
I20260923 19:35:19.632495 13020 sys_catalog.cc:458] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:19.641872 13016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:19.600001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50508 (local address 127.12.159.254:39269)
0923 19:35:19.600983 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:19.600998 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:19.602368 (+ 1370us) server_negotiation.cc:407] Connection header received
0923 19:35:19.611819 (+ 9451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:19.611847 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:19.612387 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:19.612848 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:19.615668 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:19.617724 (+ 2056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:19.619417 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:19.620456 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:19.620641 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:19.626976 (+ 6335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:19.626993 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:19.627020 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:19.627089 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:19.631660 (+ 4571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:19.633175 (+ 1515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:19.633189 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:19.633200 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:19.633504 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:19.634239 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:19.634246 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:19.634252 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:19.635157 (+ 905us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:19.639051 (+ 3894us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:19.639413 (+ 362us) server_negotiation.cc:299] Negotiation successful
0923 19:35:19.639999 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":439,"threads_started":1}
I20260923 19:35:19.651564 13025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:19.657678 13025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:19.668056 13025 catalog_manager.cc:1347] Generated new cluster ID: 6d7395cfaa1f48348fab377171d9fc79
I20260923 19:35:19.668228 13025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:19.700426 13025 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:19.701977 13025 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:19.711179 13025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a58d8c6b176e43ce9cce9d3f0c9b2d8e: Generated new TSK 0
I20260923 19:35:19.712072 13025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:19.766784 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39269
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:20.099928 13041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:20.100211 13041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:20.100365 13041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:20.107800 13041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:20.107928 13041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:20.108104 13041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:20.118436 13041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39269
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:20.119752 13041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:20.121080 13041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:20.134560 13047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:20.134639 13049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:20.134613 13046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:20.135509 13041 server_base.cc:1034] running on GCE node
I20260923 19:35:20.136150 13041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:20.137115 13041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:20.138342 13041 hybrid_clock.cc:648] HybridClock initialized: now 1790192120138293 us; error 41 us; skew 500 ppm
I20260923 19:35:20.138708 13041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:20 dist-test-slave-lzv7 krb5kdc[12934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:20.142051 13041 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:20.143525 13041 webserver.cc:460] Webserver started at http://127.12.159.193:38075/ using document root <none> and password file <none>
I20260923 19:35:20.144373 13041 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:20.144518 13041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:20.144841 13041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:20.147832 13041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "8e9d01a258804d1d96fc8527e0ad5f93"
format_stamp: "Formatted at 2026-09-23 19:35:20 on dist-test-slave-lzv7"
server_key: "262485c21669eb2b270432a106704b84"
server_key_iv: "dfd178bb01cd9f16d6d711786f42b9ab"
server_key_version: "encryptionkey@0"
I20260923 19:35:20.148581 13041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "8e9d01a258804d1d96fc8527e0ad5f93"
format_stamp: "Formatted at 2026-09-23 19:35:20 on dist-test-slave-lzv7"
server_key: "262485c21669eb2b270432a106704b84"
server_key_iv: "dfd178bb01cd9f16d6d711786f42b9ab"
server_key_version: "encryptionkey@0"
I20260923 19:35:20.154210 13041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:35:20.158239 13056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:20.159757 13041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:20.159969 13041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "8e9d01a258804d1d96fc8527e0ad5f93"
format_stamp: "Formatted at 2026-09-23 19:35:20 on dist-test-slave-lzv7"
server_key: "262485c21669eb2b270432a106704b84"
server_key_iv: "dfd178bb01cd9f16d6d711786f42b9ab"
server_key_version: "encryptionkey@0"
I20260923 19:35:20.160202 13041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:20.194164 13041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:20.199074 13041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:20.199401 13041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:20.200527 13041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:20.202106 13041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:20.202215 13041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:20.202382 13041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:20.202471 13041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:20.239487 13041 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:33399
I20260923 19:35:20.239537 13168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:33399 every 8 connection(s)
I20260923 19:35:20.240937 13041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:20.245899 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 13041
I20260923 19:35:20.246121 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:20.246721 12927 external_mini_cluster.cc:1428] Setting key 0c0eafe83c43c1010d2e188b2c5a61ae
Sep 23 19:35:20 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:35:20.265275 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:20.243736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:48781 (local address 127.12.159.254:39269)
0923 19:35:20.244199 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:20.244204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:20.245240 (+ 1036us) server_negotiation.cc:407] Connection header received
0923 19:35:20.247552 (+ 2312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:20.247559 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:20.247668 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:20.247814 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:20.249477 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.250938 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.252973 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.253482 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.253603 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:20.258515 (+ 4912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:20.258521 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:20.258524 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:20.258561 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:20.261636 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:20.262674 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:20.262678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:20.262681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:20.262802 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:20.263343 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:20.263346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:20.263348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:20.263669 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:20.263798 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:20.264653 (+ 855us) server_negotiation.cc:299] Negotiation successful
0923 19:35:20.264943 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":242,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
I20260923 19:35:20.266548 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:20.244337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39269 (local address 127.12.159.193:48781)
0923 19:35:20.245069 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:20.245113 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:20.247231 (+ 2118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:20.248020 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:20.248029 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:20.248690 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:20.249283 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:20.249301 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.251106 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.251115 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:20.252799 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:20.252814 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.253751 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.253759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:20.254145 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:20.254933 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:20.254970 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:20.258224 (+ 3254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:20.261831 (+ 3607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:20.261845 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:20.261869 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:20.262544 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:20.262929 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:20.262936 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:20.262939 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:20.263217 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:20.263814 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:20.263826 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:20.264198 (+ 372us) client_negotiation.cc:769] Sending connection context
0923 19:35:20.264529 (+ 331us) client_negotiation.cc:240] Negotiation successful
0923 19:35:20.264943 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":281,"threads_started":1}
I20260923 19:35:20.268096 13169 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39269
I20260923 19:35:20.268406 13169 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:20.269132 13169 heartbeater.cc:511] Master 127.12.159.254:39269 requested a full tablet report, sending...
I20260923 19:35:20.271590 12979 ts_manager.cc:194] Registered new tserver with Master: 8e9d01a258804d1d96fc8527e0ad5f93 (127.12.159.193:33399)
I20260923 19:35:20.273133 12979 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:48781
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:20.290299 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39269
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:20.632902 13175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:20.633189 13175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:20.633287 13175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:20.640715 13175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:20.640832 13175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:20.640954 13175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:20.650815 13175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39269
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:20.652127 13175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:20.653438 13175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:20.667877 13180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:20.667761 13181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:20.667773 13183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:20.668669 13175 server_base.cc:1034] running on GCE node
I20260923 19:35:20.669317 13175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:20.670346 13175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:20.671644 13175 hybrid_clock.cc:648] HybridClock initialized: now 1790192120671592 us; error 43 us; skew 500 ppm
I20260923 19:35:20.672005 13175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:20 dist-test-slave-lzv7 krb5kdc[12934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:20.675313 13175 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:20.677037 13175 webserver.cc:460] Webserver started at http://127.12.159.194:40005/ using document root <none> and password file <none>
I20260923 19:35:20.677758 13175 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:20.677949 13175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:20.678294 13175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:20.681259 13175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "8f6ebff32184450b8a8d9a492a3f0147"
format_stamp: "Formatted at 2026-09-23 19:35:20 on dist-test-slave-lzv7"
server_key: "7f854ae613739248b10166c8fb5cc7c1"
server_key_iv: "f1b98ed60f767a24ecda63485dc2cdd3"
server_key_version: "encryptionkey@0"
I20260923 19:35:20.682104 13175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "8f6ebff32184450b8a8d9a492a3f0147"
format_stamp: "Formatted at 2026-09-23 19:35:20 on dist-test-slave-lzv7"
server_key: "7f854ae613739248b10166c8fb5cc7c1"
server_key_iv: "f1b98ed60f767a24ecda63485dc2cdd3"
server_key_version: "encryptionkey@0"
I20260923 19:35:20.687501 13175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:35:20.691125 13190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:20.692464 13175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:20.692641 13175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "8f6ebff32184450b8a8d9a492a3f0147"
format_stamp: "Formatted at 2026-09-23 19:35:20 on dist-test-slave-lzv7"
server_key: "7f854ae613739248b10166c8fb5cc7c1"
server_key_iv: "f1b98ed60f767a24ecda63485dc2cdd3"
server_key_version: "encryptionkey@0"
I20260923 19:35:20.692852 13175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:20.708343 13175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:20.712869 13175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:20.713179 13175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:20.714226 13175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:20.715574 13175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:20.715673 13175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:20.715818 13175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:20.715894 13175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:20.750612 13175 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:44251
I20260923 19:35:20.750660 13302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:44251 every 8 connection(s)
I20260923 19:35:20.752156 13175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:20.758193 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 13175
I20260923 19:35:20.758392 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:20.758823 12927 external_mini_cluster.cc:1428] Setting key 55af60cc3959b8629b2b4ce2d176edeb
Sep 23 19:35:20 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:20.772423 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:20.754944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:43703 (local address 127.12.159.254:39269)
0923 19:35:20.755125 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:20.755130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:20.756303 (+ 1173us) server_negotiation.cc:407] Connection header received
0923 19:35:20.758233 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:20.758239 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:20.758366 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:20.758482 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:20.760005 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.760717 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.762329 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.762749 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.762884 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:20.766620 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:20.766625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:20.766628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:20.766660 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:20.769230 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:20.770094 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:20.770098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:20.770100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:20.770221 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:20.770661 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:20.770665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:20.770667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:20.770937 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:20.771092 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:20.771818 (+ 726us) server_negotiation.cc:299] Negotiation successful
0923 19:35:20.772053 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:35:20.773479 13305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:20.755449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39269 (local address 127.12.159.194:43703)
0923 19:35:20.756145 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:20.756181 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:20.757973 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:20.758715 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:20.758723 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:20.759293 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:20.759832 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:20.759860 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.760899 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.760903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:20.762182 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:20.762194 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:20.762976 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:20.762982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:20.763218 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:20.763934 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:20.763957 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:20.766390 (+ 2433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:20.769395 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:20.769404 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:20.769423 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:20.769958 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:20.770331 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:20.770337 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:20.770340 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:20.770537 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:20.771073 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:20.771081 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:20.771445 (+ 364us) client_negotiation.cc:769] Sending connection context
0923 19:35:20.771712 (+ 267us) client_negotiation.cc:240] Negotiation successful
0923 19:35:20.772297 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":263,"threads_started":1}
I20260923 19:35:20.774957 13303 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39269
I20260923 19:35:20.775339 13303 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
I20260923 19:35:20.776190 13303 heartbeater.cc:511] Master 127.12.159.254:39269 requested a full tablet report, sending...
I20260923 19:35:20.777860 12979 ts_manager.cc:194] Registered new tserver with Master: 8f6ebff32184450b8a8d9a492a3f0147 (127.12.159.194:44251)
I20260923 19:35:20.779181 12979 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:43703
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:20.798708 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39269
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:21.126537 13308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:21.126845 13308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:21.127013 13308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:21.134377 13308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:21.134529 13308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:21.134697 13308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:21.144428 13308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39269
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:21.145792 13308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:21.147158 13308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:21.160444 13316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:21.160516 13313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:21.160677 13314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:21.161335 13308 server_base.cc:1034] running on GCE node
I20260923 19:35:21.161973 13308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:21.162971 13308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:21.164157 13308 hybrid_clock.cc:648] HybridClock initialized: now 1790192121164093 us; error 62 us; skew 500 ppm
I20260923 19:35:21.164422 13308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:21.167557 13308 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:21.168915 13308 webserver.cc:460] Webserver started at http://127.12.159.195:36323/ using document root <none> and password file <none>
I20260923 19:35:21.169589 13308 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:21.169718 13308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:21.170063 13308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:21.172895 13308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "2963739b278c4406b636481e8a29f5f9"
format_stamp: "Formatted at 2026-09-23 19:35:21 on dist-test-slave-lzv7"
server_key: "bfed1df9d1d932acfbb5a75891c22aa5"
server_key_iv: "040ffc1cdc73947d46b40a0b34832273"
server_key_version: "encryptionkey@0"
I20260923 19:35:21.173872 13308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "2963739b278c4406b636481e8a29f5f9"
format_stamp: "Formatted at 2026-09-23 19:35:21 on dist-test-slave-lzv7"
server_key: "bfed1df9d1d932acfbb5a75891c22aa5"
server_key_iv: "040ffc1cdc73947d46b40a0b34832273"
server_key_version: "encryptionkey@0"
I20260923 19:35:21.179136 13308 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260923 19:35:21.182596 13323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:21.183928 13308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:21.184123 13308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "2963739b278c4406b636481e8a29f5f9"
format_stamp: "Formatted at 2026-09-23 19:35:21 on dist-test-slave-lzv7"
server_key: "bfed1df9d1d932acfbb5a75891c22aa5"
server_key_iv: "040ffc1cdc73947d46b40a0b34832273"
server_key_version: "encryptionkey@0"
I20260923 19:35:21.184333 13308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:21.207172 13308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:21.211236 13308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:21.211539 13308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:21.212620 13308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:21.214485 13308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:21.214587 13308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:21.214710 13308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:21.214790 13308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:21.247730 13308 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:39111
I20260923 19:35:21.247782 13435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:39111 every 8 connection(s)
I20260923 19:35:21.249017 13308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:21.255057 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 13308
I20260923 19:35:21.255251 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:21.255699 12927 external_mini_cluster.cc:1428] Setting key 95c737d3fbf31886d19f8d72bbe8008f
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:21.268795 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:21.251556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:34157 (local address 127.12.159.254:39269)
0923 19:35:21.251726 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:21.251731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:21.253095 (+ 1364us) server_negotiation.cc:407] Connection header received
0923 19:35:21.255063 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:21.255069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:21.255199 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:21.255315 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:21.256852 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.257632 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.259188 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.259624 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.259754 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:21.263153 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:21.263157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:21.263161 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:21.263191 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:21.265867 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.266570 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.266575 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.266578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.266701 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.267117 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.267122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.267125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.267387 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:21.267541 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:21.268227 (+ 686us) server_negotiation.cc:299] Negotiation successful
0923 19:35:21.268447 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 19:35:21.269763 13438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:21.252087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39269 (local address 127.12.159.195:34157)
0923 19:35:21.252933 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:21.252989 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:21.254758 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:21.255557 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:21.255565 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:21.256128 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:21.256678 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:21.256695 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.257789 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.257793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:21.259051 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:21.259063 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.259841 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.259849 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:21.260077 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:21.260675 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:21.260695 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:21.262945 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:21.265999 (+ 3054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:21.266008 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:21.266024 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:21.266435 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:21.266805 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:21.266810 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:21.266814 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:21.267000 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:21.267518 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:21.267527 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:21.267859 (+ 332us) client_negotiation.cc:769] Sending connection context
0923 19:35:21.268117 (+ 258us) client_negotiation.cc:240] Negotiation successful
0923 19:35:21.268664 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":353,"threads_started":1}
I20260923 19:35:21.271203 13436 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39269
I20260923 19:35:21.271546 13436 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:21.272287 13436 heartbeater.cc:511] Master 127.12.159.254:39269 requested a full tablet report, sending...
I20260923 19:35:21.273747 12979 ts_manager.cc:194] Registered new tserver with Master: 2963739b278c4406b636481e8a29f5f9 (127.12.159.195:39111)
I20260923 19:35:21.274614 12979 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:34157
I20260923 19:35:21.276289 13169 heartbeater.cc:503] Master 127.12.159.254:39269 was elected leader, sending a full tablet report...
I20260923 19:35:21.284009 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:21.329424 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:21.314035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.12.159.193:33399)
0923 19:35:21.314647 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:21.314654 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:21.314681 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:35:21.314748 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:21.314754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:21.315008 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:21.315140 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:21.316612 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.317623 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.318974 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.319562 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.319660 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:21.323698 (+ 4038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:21.323710 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:21.323724 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:21.323760 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:21.326481 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.327083 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.327090 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.327092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.327221 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.327734 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.327738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.327740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.328200 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:21.328437 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:21.328760 (+ 323us) server_negotiation.cc:299] Negotiation successful
0923 19:35:21.329024 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":287,"threads_started":1}
W20260923 19:35:21.330734 13084 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35416
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:21.375887 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:21.361659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.12.159.193:33399)
0923 19:35:21.361914 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:21.361918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:21.362240 (+ 322us) server_negotiation.cc:407] Connection header received
0923 19:35:21.362391 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:21.362394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:21.362512 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:21.362607 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:21.364010 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.364748 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.366283 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.366736 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.366834 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:21.370801 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:21.370806 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:21.370809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:21.370844 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:21.373663 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.374352 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.374356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.374359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.374486 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.374796 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.374798 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.374801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.375063 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:21.375231 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:21.375493 (+ 262us) server_negotiation.cc:299] Negotiation successful
0923 19:35:21.375658 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:35:21.377378 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 13041
I20260923 19:35:21.389576 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:21.378452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35428 (local address 127.12.159.193:33399)
0923 19:35:21.378617 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:21.378621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:21.378859 (+ 238us) server_negotiation.cc:407] Connection header received
0923 19:35:21.378974 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:21.378979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:21.379032 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:21.379108 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:21.380228 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.380902 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.382189 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.382604 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.382694 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:21.384808 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:21.384812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:21.384815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:21.384839 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:21.387352 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.387973 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.387977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.387979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.388103 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.388411 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.388414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.388416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.388672 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:21.388912 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:21.389136 (+ 224us) server_negotiation.cc:299] Negotiation successful
0923 19:35:21.389290 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:35:21.390375 13164 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:21.474452 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 13041
I20260923 19:35:21.490461 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 13175
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:35:21.506922 13450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:21.491365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37076 (local address 127.12.159.194:44251)
0923 19:35:21.491926 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:21.491933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:21.491960 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:35:21.492020 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:21.492026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:21.492237 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:21.492373 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:21.493490 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.494561 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.495714 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.496336 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.496437 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:21.501307 (+ 4870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:21.501318 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:21.501332 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:21.501364 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:21.504436 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.505036 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.505043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.505045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.505167 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.505538 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.505541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.505543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.505939 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:21.506166 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:21.506403 (+ 237us) server_negotiation.cc:299] Negotiation successful
0923 19:35:21.506589 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":289,"threads_started":1}
I20260923 19:35:21.508500 13298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:21.594879 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 13175
I20260923 19:35:21.610411 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 13308
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[12934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:35:21.625998 13452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:21.611273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55408 (local address 127.12.159.195:39111)
0923 19:35:21.611869 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:21.611876 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:21.611904 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:35:21.611975 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:21.611982 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:21.612190 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:21.612324 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:21.613458 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.614547 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.615793 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:21.616342 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:21.616435 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:21.620459 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:21.620472 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:21.620487 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:21.620521 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:21.623142 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.624077 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.624084 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.624086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.624203 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:21.624527 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:21.624530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:21.624532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:21.624856 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:21.625082 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:21.625417 (+ 335us) server_negotiation.cc:299] Negotiation successful
0923 19:35:21.625631 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":301,"threads_started":1}
I20260923 19:35:21.627395 13431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:21.711350 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 13308
I20260923 19:35:21.727522 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 12947
I20260923 19:35:21.728827 13009 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:21.833542 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 12947
2026-09-23T19:35:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3986 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[13457](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[13457](info): set up 2 sockets
Sep 23 19:35:21 dist-test-slave-lzv7 krb5kdc[13457](info): commencing operation
krb5kdc: starting...
W20260923 19:35:22.953686 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.003s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:23 dist-test-slave-lzv7 krb5kdc[13457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:23.133553 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:39449
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:39449
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:23.454846 13470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:23.455222 13470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:23.455404 13470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:23.462687 13470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:23.462855 13470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:23.462970 13470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:23.463057 13470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:23.463124 13470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:23.473753 13470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:39449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:39449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:23.475198 13470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:23.476557 13470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:23.488775 13478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:23.488776 13476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:23.488922 13475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:23.490087 13470 server_base.cc:1034] running on GCE node
I20260923 19:35:23.490831 13470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:23.492306 13470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:23.493513 13470 hybrid_clock.cc:648] HybridClock initialized: now 1790192123493449 us; error 50 us; skew 500 ppm
I20260923 19:35:23.493942 13470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:23 dist-test-slave-lzv7 krb5kdc[13457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192123, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:23.497061 13470 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:23.498744 13470 webserver.cc:460] Webserver started at http://127.12.159.254:45193/ using document root <none> and password file <none>
I20260923 19:35:23.499436 13470 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:23.499568 13470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:23.499902 13470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:23.502951 13470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "93abc81a3c8d4ac39576466fc6e82b44"
format_stamp: "Formatted at 2026-09-23 19:35:23 on dist-test-slave-lzv7"
server_key: "f29b9bb6d477ff844a94b49d97662128"
server_key_iv: "6218a995ba30387479cbfe35358095ea"
server_key_version: "encryptionkey@0"
I20260923 19:35:23.503732 13470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "93abc81a3c8d4ac39576466fc6e82b44"
format_stamp: "Formatted at 2026-09-23 19:35:23 on dist-test-slave-lzv7"
server_key: "f29b9bb6d477ff844a94b49d97662128"
server_key_iv: "6218a995ba30387479cbfe35358095ea"
server_key_version: "encryptionkey@0"
I20260923 19:35:23.508947 13470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:35:23.512482 13485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:23.513904 13470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:35:23.514103 13470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "93abc81a3c8d4ac39576466fc6e82b44"
format_stamp: "Formatted at 2026-09-23 19:35:23 on dist-test-slave-lzv7"
server_key: "f29b9bb6d477ff844a94b49d97662128"
server_key_iv: "6218a995ba30387479cbfe35358095ea"
server_key_version: "encryptionkey@0"
I20260923 19:35:23.514297 13470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:23.543608 13470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:23.549072 13470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:23.549382 13470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:23.568225 13470 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:39449
I20260923 19:35:23.568233 13536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:39449 every 8 connection(s)
I20260923 19:35:23.569802 13470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:23.571225 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 13470
I20260923 19:35:23.571462 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:23.572312 12927 external_mini_cluster.cc:1428] Setting key d8b1b19cfe5dd5ae60be9eb7bd4c0b02
I20260923 19:35:23.575001 13537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:35:23 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:23.588310 13537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44: Bootstrap starting.
I20260923 19:35:23.591566 13537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:23.592607 13537 log.cc:824] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:23.595589 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:23.574528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40962 (local address 127.12.159.254:39449)
0923 19:35:23.575397 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:23.575409 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:23.575450 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:35:23.577090 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:23.577113 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:23.577506 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:23.577905 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:23.579726 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:23.581093 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:23.582847 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:23.583489 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:23.583611 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:23.588254 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:23.588262 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:23.588278 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:23.588319 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:23.591394 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:23.592164 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:23.592171 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:23.592177 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:23.592345 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:23.592748 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:23.592755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:23.592758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:23.593306 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:23.593632 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:23.594189 (+ 557us) server_negotiation.cc:299] Negotiation successful
0923 19:35:23.594599 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":361,"threads_started":1}
I20260923 19:35:23.595746 13537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44: No bootstrap required, opened a new log
I20260923 19:35:23.603565 13537 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93abc81a3c8d4ac39576466fc6e82b44" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39449 } }
I20260923 19:35:23.603955 13537 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:23.604067 13537 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93abc81a3c8d4ac39576466fc6e82b44, State: Initialized, Role: FOLLOWER
I20260923 19:35:23.604601 13537 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93abc81a3c8d4ac39576466fc6e82b44" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39449 } }
I20260923 19:35:23.604846 13537 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:23.604986 13537 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:23.605176 13537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:23.607929 13537 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93abc81a3c8d4ac39576466fc6e82b44" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39449 } }
I20260923 19:35:23.608419 13537 leader_election.cc:302] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93abc81a3c8d4ac39576466fc6e82b44; no voters:
I20260923 19:35:23.608983 13537 leader_election.cc:288] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:23.609122 13542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:23.609790 13542 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [term 1 LEADER]: Becoming Leader. State: Replica: 93abc81a3c8d4ac39576466fc6e82b44, State: Running, Role: LEADER
I20260923 19:35:23.610364 13542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93abc81a3c8d4ac39576466fc6e82b44" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39449 } }
I20260923 19:35:23.611037 13537 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:23.613312 13544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93abc81a3c8d4ac39576466fc6e82b44. Latest consensus state: current_term: 1 leader_uuid: "93abc81a3c8d4ac39576466fc6e82b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93abc81a3c8d4ac39576466fc6e82b44" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39449 } } }
I20260923 19:35:23.613776 13544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:23.614476 13543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93abc81a3c8d4ac39576466fc6e82b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93abc81a3c8d4ac39576466fc6e82b44" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39449 } } }
I20260923 19:35:23.614735 13550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:23.614835 13543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:23.620565 13550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:23.628628 13550 catalog_manager.cc:1347] Generated new cluster ID: 6dbb55caf9944d6d8315ebc3f9df8199
I20260923 19:35:23.628750 13550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:23.646687 13550 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:23.648053 13550 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:23.655743 13550 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93abc81a3c8d4ac39576466fc6e82b44: Generated new TSK 0
I20260923 19:35:23.656781 13550 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:23.702378 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39449
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:24.035914 13563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:24.036255 13563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:24.036429 13563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:24.044006 13563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:24.044174 13563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:24.044348 13563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:24.054440 13563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39449
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:24.055850 13563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:24.057292 13563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:24.070951 13569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:24.070978 13571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:24.071043 13568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:24.073241 13563 server_base.cc:1034] running on GCE node
I20260923 19:35:24.073953 13563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:24.074914 13563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:24.076152 13563 hybrid_clock.cc:648] HybridClock initialized: now 1790192124076101 us; error 44 us; skew 500 ppm
I20260923 19:35:24.076488 13563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:24 dist-test-slave-lzv7 krb5kdc[13457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192124, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:24.079805 13563 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:24.081399 13563 webserver.cc:460] Webserver started at http://127.12.159.193:41051/ using document root <none> and password file <none>
I20260923 19:35:24.082165 13563 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:24.082304 13563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:24.082612 13563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:24.085659 13563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "8cd49ee544544e56ac5f96c0083a1a3e"
format_stamp: "Formatted at 2026-09-23 19:35:24 on dist-test-slave-lzv7"
server_key: "a4d27064cf2f4c8bf92004374f70df2c"
server_key_iv: "11c5c1c6dd072b22c772c8f5ed1aa753"
server_key_version: "encryptionkey@0"
I20260923 19:35:24.086501 13563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "8cd49ee544544e56ac5f96c0083a1a3e"
format_stamp: "Formatted at 2026-09-23 19:35:24 on dist-test-slave-lzv7"
server_key: "a4d27064cf2f4c8bf92004374f70df2c"
server_key_iv: "11c5c1c6dd072b22c772c8f5ed1aa753"
server_key_version: "encryptionkey@0"
I20260923 19:35:24.091575 13563 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:35:24.095287 13578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:24.096655 13563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:24.096836 13563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "8cd49ee544544e56ac5f96c0083a1a3e"
format_stamp: "Formatted at 2026-09-23 19:35:24 on dist-test-slave-lzv7"
server_key: "a4d27064cf2f4c8bf92004374f70df2c"
server_key_iv: "11c5c1c6dd072b22c772c8f5ed1aa753"
server_key_version: "encryptionkey@0"
I20260923 19:35:24.097069 13563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:24.125000 13563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:24.129617 13563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:24.129976 13563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:24.131143 13563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:24.132498 13563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:24.132603 13563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:24.132746 13563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:24.132818 13563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:24.167631 13563 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:40493
I20260923 19:35:24.167666 13690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:40493 every 8 connection(s)
I20260923 19:35:24.169042 13563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:24.171684 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 13563
I20260923 19:35:24.171928 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:24.172709 12927 external_mini_cluster.cc:1428] Setting key 8ef85a4ee50566a1d30a2e1d655af506
Sep 23 19:35:24 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192124, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:35:24.193136 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:24.171730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56839 (local address 127.12.159.254:39449)
0923 19:35:24.172299 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:24.172306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:24.173389 (+ 1083us) server_negotiation.cc:407] Connection header received
0923 19:35:24.175923 (+ 2534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:24.175928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:24.175995 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:24.176104 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:24.178652 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.179359 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.181214 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.182029 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.182170 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:24.186097 (+ 3927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:24.186107 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:24.186116 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:24.186165 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:24.189927 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:24.190720 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:24.190727 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:24.190733 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:24.190891 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:24.191343 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:24.191351 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:24.191357 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:24.191752 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:24.191870 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:24.192695 (+ 825us) server_negotiation.cc:299] Negotiation successful
0923 19:35:24.192872 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":278,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
I20260923 19:35:24.194386 13694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:24.172372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39449 (local address 127.12.159.193:56839)
0923 19:35:24.173212 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:24.173265 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:24.175547 (+ 2282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:24.176476 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:24.176493 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:24.177433 (+ 940us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:24.178430 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:24.178461 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.179541 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.179554 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:24.181051 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:24.181064 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.182269 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.182274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:24.182495 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:24.183261 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:24.183285 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:24.185791 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:24.190084 (+ 4293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:24.190091 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:24.190105 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:24.190569 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:24.191010 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:24.191013 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:24.191017 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:24.191204 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:24.191876 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:24.191882 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:24.192238 (+ 356us) client_negotiation.cc:769] Sending connection context
0923 19:35:24.192537 (+ 299us) client_negotiation.cc:240] Negotiation successful
0923 19:35:24.192939 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":291,"threads_started":1}
I20260923 19:35:24.196305 13691 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39449
I20260923 19:35:24.196650 13691 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:24.197404 13691 heartbeater.cc:511] Master 127.12.159.254:39449 requested a full tablet report, sending...
I20260923 19:35:24.199720 13502 ts_manager.cc:194] Registered new tserver with Master: 8cd49ee544544e56ac5f96c0083a1a3e (127.12.159.193:40493)
I20260923 19:35:24.202220 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:56839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:24.218955 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39449
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:24.552609 13697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:24.552902 13697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:24.553087 13697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:24.560563 13697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:24.560678 13697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:24.560878 13697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:24.570853 13697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39449
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:24.572296 13697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:24.573596 13697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:24.586822 13702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:24.586912 13703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:24.586884 13705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:24.588043 13697 server_base.cc:1034] running on GCE node
I20260923 19:35:24.588714 13697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:24.589645 13697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:24.590865 13697 hybrid_clock.cc:648] HybridClock initialized: now 1790192124590818 us; error 85 us; skew 500 ppm
I20260923 19:35:24.591238 13697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:24 dist-test-slave-lzv7 krb5kdc[13457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192124, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:24.599455 13697 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:24.601018 13697 webserver.cc:460] Webserver started at http://127.12.159.194:43669/ using document root <none> and password file <none>
I20260923 19:35:24.601781 13697 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:24.601985 13697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:24.602331 13697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:24.605360 13697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "f327febde2834698bf865086120b5a59"
format_stamp: "Formatted at 2026-09-23 19:35:24 on dist-test-slave-lzv7"
server_key: "54161415629c7950bec90796b62a0b2e"
server_key_iv: "fca8c1ba9181fb4e30798aa78f5a0fc0"
server_key_version: "encryptionkey@0"
I20260923 19:35:24.606205 13697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "f327febde2834698bf865086120b5a59"
format_stamp: "Formatted at 2026-09-23 19:35:24 on dist-test-slave-lzv7"
server_key: "54161415629c7950bec90796b62a0b2e"
server_key_iv: "fca8c1ba9181fb4e30798aa78f5a0fc0"
server_key_version: "encryptionkey@0"
I20260923 19:35:24.611321 13697 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:35:24.614944 13712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:24.616503 13697 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:35:24.616690 13697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "f327febde2834698bf865086120b5a59"
format_stamp: "Formatted at 2026-09-23 19:35:24 on dist-test-slave-lzv7"
server_key: "54161415629c7950bec90796b62a0b2e"
server_key_iv: "fca8c1ba9181fb4e30798aa78f5a0fc0"
server_key_version: "encryptionkey@0"
I20260923 19:35:24.616899 13697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:24.631496 13697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:24.636082 13697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:24.636384 13697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:24.637400 13697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:24.638779 13697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:24.638882 13697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:24.639048 13697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:24.639252 13697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:24.672302 13697 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:41649
I20260923 19:35:24.672348 13824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:41649 every 8 connection(s)
I20260923 19:35:24.673683 13697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:24.675747 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 13697
I20260923 19:35:24.675951 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:24.676484 12927 external_mini_cluster.cc:1428] Setting key 7e3c3e3f48b6537a94e32dbc9c002104
Sep 23 19:35:24 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192124, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
I20260923 19:35:24.696488 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:24.676517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:59503 (local address 127.12.159.254:39449)
0923 19:35:24.676735 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:24.676742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:24.678275 (+ 1533us) server_negotiation.cc:407] Connection header received
0923 19:35:24.680210 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:24.680218 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:24.680309 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:24.680421 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:24.681920 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.682960 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.684908 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.685557 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.685702 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:24.689490 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:24.689499 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:24.689507 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:24.689564 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:24.693200 (+ 3636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:24.694071 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:24.694075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:24.694078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:24.694204 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:24.694643 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:24.694646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:24.694648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:24.694909 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:24.695018 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:24.695904 (+ 886us) server_negotiation.cc:299] Negotiation successful
0923 19:35:24.696147 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260923 19:35:24.697476 13827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:24.677098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39449 (local address 127.12.159.194:59503)
0923 19:35:24.678101 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:24.678155 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:24.679935 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:24.680638 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:24.680646 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:24.681160 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:24.681723 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:24.681741 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.683123 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.683129 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:24.684754 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:24.684766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:24.685832 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:24.685840 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:24.686091 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:24.686815 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:24.686837 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:24.689236 (+ 2399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:24.693352 (+ 4116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:24.693359 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:24.693373 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:24.693948 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:24.694304 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:24.694331 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:24.694337 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:24.694549 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:24.695041 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:24.695052 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:24.695485 (+ 433us) client_negotiation.cc:769] Sending connection context
0923 19:35:24.695798 (+ 313us) client_negotiation.cc:240] Negotiation successful
0923 19:35:24.696335 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":407,"threads_started":1}
I20260923 19:35:24.699031 13825 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39449
I20260923 19:35:24.699386 13825 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:24.700290 13825 heartbeater.cc:511] Master 127.12.159.254:39449 requested a full tablet report, sending...
I20260923 19:35:24.702266 13502 ts_manager.cc:194] Registered new tserver with Master: f327febde2834698bf865086120b5a59 (127.12.159.194:41649)
I20260923 19:35:24.703157 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:59503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:24.719388 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39449
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:33223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:25.044667 13830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:25.044991 13830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:25.045149 13830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:25.052418 13830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:25.052536 13830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:25.052650 13830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:25.062599 13830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:33223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39449
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:25.063869 13830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:25.065210 13830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:25.079074 13838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:25.079145 13836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:25.079180 13835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:25.080080 13830 server_base.cc:1034] running on GCE node
I20260923 19:35:25.080737 13830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:25.081738 13830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:25.083029 13830 hybrid_clock.cc:648] HybridClock initialized: now 1790192125082970 us; error 47 us; skew 500 ppm
I20260923 19:35:25.083406 13830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:25.086697 13830 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:25.088142 13830 webserver.cc:460] Webserver started at http://127.12.159.195:34375/ using document root <none> and password file <none>
I20260923 19:35:25.088842 13830 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:25.088974 13830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:25.089330 13830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:25.092283 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "afff4d8611e24aada60f7bec55fd275a"
format_stamp: "Formatted at 2026-09-23 19:35:25 on dist-test-slave-lzv7"
server_key: "593deeee0c6ea230b445ff001afeed02"
server_key_iv: "b0043bd5e1f181fd7c0fc3b2212d4220"
server_key_version: "encryptionkey@0"
I20260923 19:35:25.093061 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "afff4d8611e24aada60f7bec55fd275a"
format_stamp: "Formatted at 2026-09-23 19:35:25 on dist-test-slave-lzv7"
server_key: "593deeee0c6ea230b445ff001afeed02"
server_key_iv: "b0043bd5e1f181fd7c0fc3b2212d4220"
server_key_version: "encryptionkey@0"
I20260923 19:35:25.098301 13830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:35:25.101953 13845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:25.103255 13830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:25.103423 13830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "afff4d8611e24aada60f7bec55fd275a"
format_stamp: "Formatted at 2026-09-23 19:35:25 on dist-test-slave-lzv7"
server_key: "593deeee0c6ea230b445ff001afeed02"
server_key_iv: "b0043bd5e1f181fd7c0fc3b2212d4220"
server_key_version: "encryptionkey@0"
I20260923 19:35:25.103633 13830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:25.137029 13830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:25.141557 13830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:25.141865 13830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:25.142856 13830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:25.144196 13830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:25.144266 13830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:25.144459 13830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:25.144573 13830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260923 19:35:25.178397 13830 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:33867
I20260923 19:35:25.178444 13957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:33867 every 8 connection(s)
I20260923 19:35:25.179736 13830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:25.187685 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 13830
I20260923 19:35:25.187879 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:25.188289 12927 external_mini_cluster.cc:1428] Setting key 7317c4c42644881a9e6fd52a30d4c728
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:25.199067 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.182388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:54867 (local address 127.12.159.254:39449)
0923 19:35:25.182566 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.182570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.183625 (+ 1055us) server_negotiation.cc:407] Connection header received
0923 19:35:25.185445 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.185451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.185598 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.185714 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.187230 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.188085 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.189744 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.190204 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.190356 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.193635 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.193641 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.193646 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.193689 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.196092 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.196774 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.196782 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.196787 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.196916 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.197329 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.197334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.197338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.197611 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.197766 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.198490 (+ 724us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.198714 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:35:25.199980 13960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.182788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39449 (local address 127.12.159.195:54867)
0923 19:35:25.183460 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.183503 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.185175 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.185967 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.185975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.186489 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:25.187017 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.187044 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.188238 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.188242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.189610 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.189621 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.190443 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.190452 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.190683 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.191358 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:25.191383 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:25.193439 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:25.196229 (+ 2790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:25.196237 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:25.196252 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:25.196654 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:25.197024 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:25.197029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:25.197041 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:25.197215 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:25.197738 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:25.197746 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:25.198137 (+ 391us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.198405 (+ 268us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.198904 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":282,"threads_started":1}
I20260923 19:35:25.201447 13958 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39449
I20260923 19:35:25.201828 13958 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:25.202736 13958 heartbeater.cc:511] Master 127.12.159.254:39449 requested a full tablet report, sending...
I20260923 19:35:25.204272 13502 ts_manager.cc:194] Registered new tserver with Master: afff4d8611e24aada60f7bec55fd275a (127.12.159.195:33867)
I20260923 19:35:25.205065 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:54867
I20260923 19:35:25.205417 13691 heartbeater.cc:503] Master 127.12.159.254:39449 was elected leader, sending a full tablet report...
I20260923 19:35:25.215538 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:35:25.234540 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.221720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40976 (local address 127.12.159.254:39449)
0923 19:35:25.221935 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.221939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.222435 (+ 496us) server_negotiation.cc:407] Connection header received
0923 19:35:25.222643 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.222649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.222724 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.222824 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.224242 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.224969 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.226276 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.226681 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.226808 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.229343 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.229348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.229351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.229382 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.231877 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.232524 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.232531 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.232534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.232665 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.233031 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.233037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.233043 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.233352 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.233634 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.234009 (+ 375us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.234220 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:35:25.240582 13502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:25.247682 13502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:25.282163 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.261370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36752 (local address 127.12.159.193:40493)
0923 19:35:25.274057 (+ 12687us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.274067 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.274100 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:35:25.274216 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.274224 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.274552 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.274819 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:25.276017 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.277036 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.279955 (+ 2919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.280979 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.281203 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.281388 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.281618 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.281776 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12483,"thread_start_us":13183,"threads_started":1}
I20260923 19:35:25.282265 13972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.260829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:40493 (local address 127.0.0.1:36752)
0923 19:35:25.261958 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.261981 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.270724 (+ 8743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.275092 (+ 4368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.275096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.275144 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:25.275776 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.275788 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.277167 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.277175 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.279767 (+ 2592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.279786 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.281190 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.281196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.281368 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.281418 (+ 50us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.281575 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.281777 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":2,"thread_start_us":778,"threads_started":1}
I20260923 19:35:25.282733 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.259859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33867 (local address 127.0.0.1:41096)
0923 19:35:25.260837 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.260886 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.261091 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.274845 (+ 13754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.274852 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.274891 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:25.275455 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.275471 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.277507 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.277512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.280010 (+ 2498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.280019 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.281855 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.281862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.282047 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.282096 (+ 49us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.282167 (+ 71us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.282300 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":212,"thread_start_us":1439,"threads_started":1}
I20260923 19:35:25.283073 13974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.262253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:41649 (local address 127.0.0.1:46044)
0923 19:35:25.271932 (+ 9679us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.271959 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.273520 (+ 1561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.275170 (+ 1650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.275178 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.275208 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:25.275782 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.275790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.277665 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.277669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.279970 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.279991 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.282121 (+ 2130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.282132 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.282298 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.282325 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.282402 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.282525 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9478,"mutex_wait_us":59,"thread_start_us":10976,"threads_started":1}
I20260923 19:35:25.283823 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.262509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46044 (local address 127.12.159.194:41649)
0923 19:35:25.274575 (+ 12066us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.274584 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.274611 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:35:25.274701 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.274708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.274969 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.275183 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:25.275986 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.277484 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.280140 (+ 2656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.281609 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.281774 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.281972 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.283374 (+ 1402us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.283540 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11906,"thread_start_us":11782,"threads_started":1}
I20260923 19:35:25.284198 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.260307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41096 (local address 127.12.159.195:33867)
0923 19:35:25.274127 (+ 13820us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.274135 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.274165 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:35:25.274262 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.274268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.274540 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.274804 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:25.275697 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.277353 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.280206 (+ 2853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.281603 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.283404 (+ 1801us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.283609 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.283681 (+ 72us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.283840 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13652,"thread_start_us":13517,"threads_started":1}
I20260923 19:35:25.286619 13626 tablet_service.cc:1467] Processing CreateTablet for tablet 0142a12dfd5e43c1909f438a471b37f8 (DEFAULT_TABLE table=test-table [id=dac77996098c41f8ad3f0a236f802118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:25.287467 13760 tablet_service.cc:1467] Processing CreateTablet for tablet 0142a12dfd5e43c1909f438a471b37f8 (DEFAULT_TABLE table=test-table [id=dac77996098c41f8ad3f0a236f802118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:25.287609 13893 tablet_service.cc:1467] Processing CreateTablet for tablet 0142a12dfd5e43c1909f438a471b37f8 (DEFAULT_TABLE table=test-table [id=dac77996098c41f8ad3f0a236f802118]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:25.288259 13626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0142a12dfd5e43c1909f438a471b37f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:25.288913 13893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0142a12dfd5e43c1909f438a471b37f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:25.288940 13760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0142a12dfd5e43c1909f438a471b37f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:25.299808 13976 tablet_bootstrap.cc:492] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a: Bootstrap starting.
I20260923 19:35:25.302788 13978 tablet_bootstrap.cc:492] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e: Bootstrap starting.
I20260923 19:35:25.304813 13976 tablet_bootstrap.cc:654] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:25.306254 13976 log.cc:824] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:25.306403 13978 tablet_bootstrap.cc:654] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:25.307966 13977 tablet_bootstrap.cc:492] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59: Bootstrap starting.
I20260923 19:35:25.309110 13978 log.cc:824] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:25.311967 13976 tablet_bootstrap.cc:492] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a: No bootstrap required, opened a new log
I20260923 19:35:25.312250 13976 ts_tablet_manager.cc:1397] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260923 19:35:25.312690 13977 tablet_bootstrap.cc:654] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:25.314407 13977 log.cc:824] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:25.315490 13978 tablet_bootstrap.cc:492] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e: No bootstrap required, opened a new log
I20260923 19:35:25.315763 13978 ts_tablet_manager.cc:1397] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260923 19:35:25.323957 13977 tablet_bootstrap.cc:492] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59: No bootstrap required, opened a new log
I20260923 19:35:25.324257 13977 ts_tablet_manager.cc:1397] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.004s
I20260923 19:35:25.324092 13978 raft_consensus.cc:348] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.324576 13978 raft_consensus.cc:374] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:25.324682 13978 raft_consensus.cc:729] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd49ee544544e56ac5f96c0083a1a3e, State: Initialized, Role: FOLLOWER
I20260923 19:35:25.324764 13976 raft_consensus.cc:348] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.325208 13976 raft_consensus.cc:374] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:25.325380 13976 raft_consensus.cc:729] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afff4d8611e24aada60f7bec55fd275a, State: Initialized, Role: FOLLOWER
I20260923 19:35:25.325372 13978 consensus_queue.cc:260] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.326251 13976 consensus_queue.cc:260] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.330801 13958 heartbeater.cc:503] Master 127.12.159.254:39449 was elected leader, sending a full tablet report...
I20260923 19:35:25.331411 13976 ts_tablet_manager.cc:1428] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a: Time spent starting tablet: real 0.019s user 0.014s sys 0.005s
I20260923 19:35:25.333040 13978 ts_tablet_manager.cc:1428] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e: Time spent starting tablet: real 0.017s user 0.014s sys 0.004s
I20260923 19:35:25.336822 13977 raft_consensus.cc:348] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.337342 13977 raft_consensus.cc:374] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:25.337463 13977 raft_consensus.cc:729] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f327febde2834698bf865086120b5a59, State: Initialized, Role: FOLLOWER
I20260923 19:35:25.338117 13977 consensus_queue.cc:260] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.339063 13825 heartbeater.cc:503] Master 127.12.159.254:39449 was elected leader, sending a full tablet report...
I20260923 19:35:25.339699 13977 ts_tablet_manager.cc:1428] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260923 19:35:25.340572 13982 raft_consensus.cc:482] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:25.340801 13982 raft_consensus.cc:504] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.342787 13982 leader_election.cc:288] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afff4d8611e24aada60f7bec55fd275a (127.12.159.195:33867), f327febde2834698bf865086120b5a59 (127.12.159.194:41649)
I20260923 19:35:25.349315 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.343051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:42297 (local address 127.12.159.195:33867)
0923 19:35:25.343271 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.343278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.343738 (+ 460us) server_negotiation.cc:407] Connection header received
0923 19:35:25.344320 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.344325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.344398 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.344488 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:25.344999 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.345847 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.347555 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.348406 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.348587 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.348662 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.348935 (+ 273us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.349052 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:35:25.349408 13984 raft_consensus.cc:482] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:25.349726 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.344005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:42553 (local address 127.12.159.194:41649)
0923 19:35:25.344215 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.344223 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.344469 (+ 246us) server_negotiation.cc:407] Connection header received
0923 19:35:25.344669 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.344673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.344738 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.344838 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:25.345446 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.346234 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.347910 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.348678 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.348842 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.348921 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.349272 (+ 351us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.349430 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:35:25.349704 13984 raft_consensus.cc:504] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.350351 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.343773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:41649 (local address 127.12.159.193:42553)
0923 19:35:25.344376 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.344390 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.344534 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.344850 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.344854 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.344876 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:25.345307 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.345316 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.346370 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.346376 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.347757 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.347768 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.348896 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.348902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.349066 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.349114 (+ 48us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.349924 (+ 810us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.350053 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":292,"threads_started":1}
I20260923 19:35:25.351203 13780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0142a12dfd5e43c1909f438a471b37f8" candidate_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f327febde2834698bf865086120b5a59" is_pre_election: true
I20260923 19:35:25.351538 13984 leader_election.cc:288] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afff4d8611e24aada60f7bec55fd275a (127.12.159.195:33867), 8cd49ee544544e56ac5f96c0083a1a3e (127.12.159.193:40493)
I20260923 19:35:25.351706 13780 raft_consensus.cc:2454] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd49ee544544e56ac5f96c0083a1a3e in term 0.
I20260923 19:35:25.351899 13985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.342991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33867 (local address 127.12.159.193:42297)
0923 19:35:25.343654 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.343676 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.344173 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.344517 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.344521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.344549 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:25.344860 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.344868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.345974 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.345981 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.347403 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.347415 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.348609 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.348616 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.348776 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.348799 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.348915 (+ 116us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.349051 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":294,"threads_started":1}
I20260923 19:35:25.352602 13581 leader_election.cc:302] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cd49ee544544e56ac5f96c0083a1a3e, f327febde2834698bf865086120b5a59; no voters:
I20260923 19:35:25.352968 13982 raft_consensus.cc:2781] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:25.352929 13913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0142a12dfd5e43c1909f438a471b37f8" candidate_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afff4d8611e24aada60f7bec55fd275a" is_pre_election: true
I20260923 19:35:25.353123 13982 raft_consensus.cc:482] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:25.353300 13982 raft_consensus.cc:3037] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:25.353431 13913 raft_consensus.cc:2454] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd49ee544544e56ac5f96c0083a1a3e in term 0.
I20260923 19:35:25.357643 13982 raft_consensus.cc:504] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.359124 13982 leader_election.cc:288] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [CANDIDATE]: Term 1 election: Requested vote from peers afff4d8611e24aada60f7bec55fd275a (127.12.159.195:33867), f327febde2834698bf865086120b5a59 (127.12.159.194:41649)
I20260923 19:35:25.359122 13913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0142a12dfd5e43c1909f438a471b37f8" candidate_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afff4d8611e24aada60f7bec55fd275a"
I20260923 19:35:25.359335 13913 raft_consensus.cc:3037] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:25.359597 13780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0142a12dfd5e43c1909f438a471b37f8" candidate_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f327febde2834698bf865086120b5a59"
I20260923 19:35:25.359825 13780 raft_consensus.cc:3037] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:25.362686 13913 raft_consensus.cc:2454] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd49ee544544e56ac5f96c0083a1a3e in term 1.
I20260923 19:35:25.363147 13581 leader_election.cc:302] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cd49ee544544e56ac5f96c0083a1a3e, afff4d8611e24aada60f7bec55fd275a; no voters:
I20260923 19:35:25.363487 13780 raft_consensus.cc:2454] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd49ee544544e56ac5f96c0083a1a3e in term 1.
I20260923 19:35:25.363557 13982 raft_consensus.cc:2781] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:25.366056 13982 raft_consensus.cc:686] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [term 1 LEADER]: Becoming Leader. State: Replica: 8cd49ee544544e56ac5f96c0083a1a3e, State: Running, Role: LEADER
I20260923 19:35:25.366451 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.352423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:57011 (local address 127.12.159.193:40493)
0923 19:35:25.352574 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.352581 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.359134 (+ 6553us) server_negotiation.cc:407] Connection header received
0923 19:35:25.359378 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.359383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.359455 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.359541 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:25.360626 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.361657 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.364560 (+ 2903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.365402 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.365617 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.365691 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.366162 (+ 471us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.366279 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260923 19:35:25.366683 13982 consensus_queue.cc:237] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } }
I20260923 19:35:25.367449 13987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.351932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:40493 (local address 127.12.159.194:57011)
0923 19:35:25.359033 (+ 7101us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.359050 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.359222 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.359695 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.359700 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.359728 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:25.360432 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.360452 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.361875 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.361880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.364394 (+ 2514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.364406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.365646 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.365653 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.365894 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.365993 (+ 99us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.366994 (+ 1001us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.367150 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6992,"mutex_wait_us":67,"thread_start_us":6091,"threads_started":1}
I20260923 19:35:25.368453 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.352202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:43247 (local address 127.12.159.195:33867)
0923 19:35:25.353065 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.353071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.358476 (+ 5405us) server_negotiation.cc:407] Connection header received
0923 19:35:25.358676 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.358683 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.358770 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.358861 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:25.360301 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.362899 (+ 2598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.366191 (+ 3292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.367361 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.367486 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.367551 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.368101 (+ 550us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.368220 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733}
I20260923 19:35:25.368320 13646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0142a12dfd5e43c1909f438a471b37f8" candidate_uuid: "f327febde2834698bf865086120b5a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" is_pre_election: true
I20260923 19:35:25.369266 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.351726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33867 (local address 127.12.159.194:43247)
0923 19:35:25.358373 (+ 6647us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:25.358389 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:25.358539 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:25.359479 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:25.359485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:25.359514 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:25.360128 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.360141 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.363086 (+ 2945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.363090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.365992 (+ 2902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:25.366008 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.367738 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.367744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:25.367914 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.367943 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:35:25.368682 (+ 739us) client_negotiation.cc:240] Negotiation successful
0923 19:35:25.368808 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6531,"mutex_wait_us":4,"thread_start_us":7053,"threads_started":1}
I20260923 19:35:25.370020 13913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0142a12dfd5e43c1909f438a471b37f8" candidate_uuid: "f327febde2834698bf865086120b5a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afff4d8611e24aada60f7bec55fd275a" is_pre_election: true
I20260923 19:35:25.370319 13913 raft_consensus.cc:2379] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f327febde2834698bf865086120b5a59 in current term 1: Already voted for candidate 8cd49ee544544e56ac5f96c0083a1a3e in this term.
I20260923 19:35:25.371003 13715 leader_election.cc:302] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f327febde2834698bf865086120b5a59; no voters: 8cd49ee544544e56ac5f96c0083a1a3e, afff4d8611e24aada60f7bec55fd275a
I20260923 19:35:25.371426 13984 raft_consensus.cc:2726] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:35:25.372534 13502 catalog_manager.cc:5495] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd49ee544544e56ac5f96c0083a1a3e (127.12.159.193). New cstate: current_term: 1 leader_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afff4d8611e24aada60f7bec55fd275a" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f327febde2834698bf865086120b5a59" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 41649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd49ee544544e56ac5f96c0083a1a3e" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40493 } health_report { overall_health: HEALTHY } } }
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:25.403585 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.388680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36756 (local address 127.12.159.193:40493)
0923 19:35:25.388873 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.388878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.389378 (+ 500us) server_negotiation.cc:407] Connection header received
0923 19:35:25.389519 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.389522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.389597 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.389682 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.391213 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.391946 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.393241 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.393708 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.393895 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.397770 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.397785 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.397863 (+ 78us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.397902 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.400917 (+ 3015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.401553 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.401561 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.401563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.401689 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.402111 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.402115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.402117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.402510 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.402756 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.402954 (+ 198us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.403163 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260923 19:35:25.421439 13692 tablet.cc:2369] T 0142a12dfd5e43c1909f438a471b37f8 P 8cd49ee544544e56ac5f96c0083a1a3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:35:25.425657 13826 tablet.cc:2369] T 0142a12dfd5e43c1909f438a471b37f8 P f327febde2834698bf865086120b5a59: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260923 19:35:25.431340 13959 tablet.cc:2369] T 0142a12dfd5e43c1909f438a471b37f8 P afff4d8611e24aada60f7bec55fd275a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:25.449898 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.436879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36758 (local address 127.12.159.193:40493)
0923 19:35:25.437109 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.437122 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.437250 (+ 128us) server_negotiation.cc:407] Connection header received
0923 19:35:25.437411 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.437414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.437477 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.437578 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.438900 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.439627 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.440798 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.441182 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.441275 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.444911 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.444917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.444920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.444953 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.447701 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.448251 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.448255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.448257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.448376 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.448683 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.448686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.448688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.448931 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.449116 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.449356 (+ 240us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.449515 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:25.493954 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.480071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36766 (local address 127.12.159.193:40493)
0923 19:35:25.480311 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.480318 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.480611 (+ 293us) server_negotiation.cc:407] Connection header received
0923 19:35:25.480832 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.480837 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.480901 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.481011 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.482430 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.483160 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.484359 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.484793 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.484934 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.488781 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.488786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.488789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.488824 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.491350 (+ 2526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.491993 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.492005 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.492008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.492130 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.492497 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.492502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.492506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.492821 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.493087 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.493351 (+ 264us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.493575 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260923 19:35:25.495677 13606 tablet_service.cc:2908] Rejecting scan request for tablet 0142a12dfd5e43c1909f438a471b37f8: Uninitialized: clean time has not yet been initialized
I20260923 19:35:25.498513 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 13563
I20260923 19:35:25.511175 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.499532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36772 (local address 127.12.159.193:40493)
0923 19:35:25.499699 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.499703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.499977 (+ 274us) server_negotiation.cc:407] Connection header received
0923 19:35:25.500127 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.500130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.500201 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.500293 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.501497 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.502292 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.503417 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.503811 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.503906 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.506096 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.506101 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.506104 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.506133 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.508903 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.509497 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.509500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.509502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.509630 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.510023 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.510026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.510028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.510279 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.510494 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.510724 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.510884 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:35:25.511924 13686 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:25.616205 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 13563
I20260923 19:35:25.635514 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 13697
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:35:25.650285 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.636312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46052 (local address 127.12.159.194:41649)
0923 19:35:25.636470 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.636474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.636526 (+ 52us) server_negotiation.cc:407] Connection header received
0923 19:35:25.636689 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.636693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.636767 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.636866 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.638097 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.638827 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.640061 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.640453 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.640560 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.644720 (+ 4160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.644734 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.644750 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.644781 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.647760 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.648468 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.648475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.648478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.648612 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.648939 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.648942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.648944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.649280 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.649514 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.649721 (+ 207us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.649933 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:35:25.650936 13820 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:25.763522 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 13697
I20260923 19:35:25.780156 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 13830
Sep 23 19:35:25 dist-test-slave-lzv7 krb5kdc[13457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:35:25.796551 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:25.780910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41104 (local address 127.12.159.195:33867)
0923 19:35:25.781101 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:25.781105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:25.781177 (+ 72us) server_negotiation.cc:407] Connection header received
0923 19:35:25.781335 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:25.781339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:25.781413 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:25.781507 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:25.783051 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.783748 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.785171 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:25.785565 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:25.785677 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:25.790494 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:25.790512 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:25.790529 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:25.790569 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:25.793964 (+ 3395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.794702 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.794710 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.794712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.794838 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:25.795215 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:25.795218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:25.795220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:25.795601 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:25.795824 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:25.796163 (+ 339us) server_negotiation.cc:299] Negotiation successful
0923 19:35:25.796330 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:35:25.797241 13953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:25.887054 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 13830
I20260923 19:35:25.903718 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 13470
I20260923 19:35:25.904987 13532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:26.014289 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 13470
2026-09-23T19:35:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4180 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:26 dist-test-slave-lzv7 krb5kdc[14008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:26 dist-test-slave-lzv7 krb5kdc[14008](info): set up 2 sockets
Sep 23 19:35:26 dist-test-slave-lzv7 krb5kdc[14008](info): commencing operation
krb5kdc: starting...
W20260923 19:35:27.113797 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:27 dist-test-slave-lzv7 krb5kdc[14008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:27.294294 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33665
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:27.623831 14021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:27.624111 14021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:27.624270 14021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:27.631342 14021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:27.631440 14021 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 19:35:27.631493 14021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:27.631587 14021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:27.631662 14021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:27.631776 14021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:27.641634 14021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33665
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:27.642959 14021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:27.644279 14021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:27.657085 14027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:27.657618 14029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:27.657735 14026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:27.658157 14021 server_base.cc:1034] running on GCE node
I20260923 19:35:27.658973 14021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:27.660559 14021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:27.661791 14021 hybrid_clock.cc:648] HybridClock initialized: now 1790192127661731 us; error 31 us; skew 500 ppm
I20260923 19:35:27.662164 14021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:27 dist-test-slave-lzv7 krb5kdc[14008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192127, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:27.665355 14021 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:27.666993 14021 webserver.cc:460] Webserver started at http://127.12.159.254:40665/ using document root <none> and password file <none>
I20260923 19:35:27.667729 14021 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:27.667865 14021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:27.668195 14021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:27.671600 14021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "3149cbd51ac34758831256c221481045"
format_stamp: "Formatted at 2026-09-23 19:35:27 on dist-test-slave-lzv7"
server_key: "6b16b53384216fe014cd3abf9b5a681c"
server_key_iv: "feda696e0dcd78bbf6160ff554f2b6e9"
server_key_version: "encryptionkey@0"
I20260923 19:35:27.672524 14021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "3149cbd51ac34758831256c221481045"
format_stamp: "Formatted at 2026-09-23 19:35:27 on dist-test-slave-lzv7"
server_key: "6b16b53384216fe014cd3abf9b5a681c"
server_key_iv: "feda696e0dcd78bbf6160ff554f2b6e9"
server_key_version: "encryptionkey@0"
I20260923 19:35:27.677901 14021 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:35:27.681408 14036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:27.682832 14021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:35:27.683033 14021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "3149cbd51ac34758831256c221481045"
format_stamp: "Formatted at 2026-09-23 19:35:27 on dist-test-slave-lzv7"
server_key: "6b16b53384216fe014cd3abf9b5a681c"
server_key_iv: "feda696e0dcd78bbf6160ff554f2b6e9"
server_key_version: "encryptionkey@0"
I20260923 19:35:27.683274 14021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:27.701071 14021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:27.705539 14021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:27.705858 14021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:27.727635 14021 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:33665
I20260923 19:35:27.727660 14097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:33665 every 8 connection(s)
I20260923 19:35:27.729148 14021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:27.731782 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 14021
I20260923 19:35:27.732044 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:27.732699 12927 external_mini_cluster.cc:1428] Setting key 413c9f19ae0b45ca3ee71095b1704236
I20260923 19:35:27.733201 14098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:27.748103 14098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045: Bootstrap starting.
Sep 23 19:35:27 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:27.752297 14098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:27.753719 14098 log.cc:824] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:27.757274 14098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045: No bootstrap required, opened a new log
I20260923 19:35:27.758337 14101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:27.734789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.12.159.254:33665)
0923 19:35:27.735578 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:27.735589 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:27.735632 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:35:27.737784 (+ 2152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:27.737860 (+ 76us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:27.738267 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:27.738607 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:27.740328 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:27.741653 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:27.743493 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:27.744281 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:27.744432 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:27.749288 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:27.749299 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:27.749319 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:27.749371 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:27.753467 (+ 4096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:27.754390 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:27.754399 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:27.754409 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:27.754592 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:27.755032 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:27.755035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:27.755065 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:27.755777 (+ 712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:27.756070 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:27.756434 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 19:35:27.756882 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":389,"threads_started":1}
I20260923 19:35:27.765738 14098 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3149cbd51ac34758831256c221481045" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33665 } }
I20260923 19:35:27.766129 14098 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:27.766206 14098 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3149cbd51ac34758831256c221481045, State: Initialized, Role: FOLLOWER
I20260923 19:35:27.766752 14098 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3149cbd51ac34758831256c221481045" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33665 } }
I20260923 19:35:27.766944 14098 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:27.767038 14098 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:27.767159 14098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:27.769304 14098 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3149cbd51ac34758831256c221481045" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33665 } }
I20260923 19:35:27.769925 14098 leader_election.cc:302] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3149cbd51ac34758831256c221481045; no voters:
I20260923 19:35:27.770496 14098 leader_election.cc:288] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:27.770627 14103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:27.771319 14103 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [term 1 LEADER]: Becoming Leader. State: Replica: 3149cbd51ac34758831256c221481045, State: Running, Role: LEADER
I20260923 19:35:27.771800 14103 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3149cbd51ac34758831256c221481045" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33665 } }
I20260923 19:35:27.772540 14098 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:27.775875 14105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3149cbd51ac34758831256c221481045. Latest consensus state: current_term: 1 leader_uuid: "3149cbd51ac34758831256c221481045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3149cbd51ac34758831256c221481045" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33665 } } }
I20260923 19:35:27.777274 14105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:27.776388 14104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3149cbd51ac34758831256c221481045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3149cbd51ac34758831256c221481045" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33665 } } }
I20260923 19:35:27.783080 14104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:27.783221 14112 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:27.787902 14112 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:27.796203 14112 catalog_manager.cc:1347] Generated new cluster ID: 87ecf9e535ae45d29302e0f1ee8e85b2
I20260923 19:35:27.796316 14112 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:27.808545 14112 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:27.809960 14112 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:27.816277 14112 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045: Generated new TSK 0
I20260923 19:35:27.817075 14112 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:27.871052 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33665
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:28.199703 14124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:28.200027 14124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:28.200205 14124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:28.207515 14124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:28.207688 14124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:28.207841 14124 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:35:28.207994 14124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:28.217926 14124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:33665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:28.219272 14124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:28.220659 14124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:28.233461 14129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:28.233547 14130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:28.233502 14132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:28.234570 14124 server_base.cc:1034] running on GCE node
I20260923 19:35:28.235193 14124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:28.236141 14124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:28.237385 14124 hybrid_clock.cc:648] HybridClock initialized: now 1790192128237319 us; error 41 us; skew 500 ppm
I20260923 19:35:28.237687 14124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:28 dist-test-slave-lzv7 krb5kdc[14008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:28.240825 14124 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:28.242339 14124 webserver.cc:460] Webserver started at http://127.12.159.193:39205/ using document root <none> and password file <none>
I20260923 19:35:28.243034 14124 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:28.243161 14124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:28.243517 14124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:28.246407 14124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "4cf4e332e0424d32922a03c038ba37d9"
format_stamp: "Formatted at 2026-09-23 19:35:28 on dist-test-slave-lzv7"
server_key: "311d36922642cb10872c727ee64ab274"
server_key_iv: "fd4dc7569f0566b78d6758db5a230a8c"
server_key_version: "encryptionkey@0"
I20260923 19:35:28.247258 14124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "4cf4e332e0424d32922a03c038ba37d9"
format_stamp: "Formatted at 2026-09-23 19:35:28 on dist-test-slave-lzv7"
server_key: "311d36922642cb10872c727ee64ab274"
server_key_iv: "fd4dc7569f0566b78d6758db5a230a8c"
server_key_version: "encryptionkey@0"
I20260923 19:35:28.252480 14124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:28.256057 14139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:28.257524 14124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:28.257661 14124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "4cf4e332e0424d32922a03c038ba37d9"
format_stamp: "Formatted at 2026-09-23 19:35:28 on dist-test-slave-lzv7"
server_key: "311d36922642cb10872c727ee64ab274"
server_key_iv: "fd4dc7569f0566b78d6758db5a230a8c"
server_key_version: "encryptionkey@0"
I20260923 19:35:28.257903 14124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:28.272837 14124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:28.276928 14124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:28.277160 14124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:28.280030 14124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:28.280164 14124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:28.280323 14124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:28.280385 14124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:35:28 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:28.308838 14149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.281208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33665 (local address 127.12.159.193:41295)
0923 19:35:28.282312 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:28.282372 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:28.284683 (+ 2311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:28.285464 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:28.285472 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:28.286243 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:28.287394 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.287428 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.288998 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.289005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.290927 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.290965 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.292570 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.292580 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.292999 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.293936 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:28.293978 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:28.298467 (+ 4489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:28.303083 (+ 4616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.303096 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.303128 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.304064 (+ 936us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.304561 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.304566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.304570 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.304814 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.305456 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:28.305470 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:28.306099 (+ 629us) client_negotiation.cc:769] Sending connection context
0923 19:35:28.306445 (+ 346us) client_negotiation.cc:240] Negotiation successful
0923 19:35:28.307075 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"thread_start_us":483,"threads_started":1}
I20260923 19:35:28.309898 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.280501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:41295 (local address 127.12.159.254:33665)
0923 19:35:28.283063 (+ 2562us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:28.283069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:28.283107 (+ 38us) server_negotiation.cc:407] Connection header received
0923 19:35:28.284983 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:28.284988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:28.285087 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:28.285235 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:28.287667 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.288840 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.291121 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.291996 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.292162 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.298828 (+ 6666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:28.298834 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:28.298837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:28.298876 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:28.302853 (+ 3977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.304266 (+ 1413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.304275 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.304281 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.304423 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.304960 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.304969 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.304971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.305256 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:28.308822 (+ 3566us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:28.309361 (+ 539us) server_negotiation.cc:299] Negotiation successful
0923 19:35:28.309541 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2426,"thread_start_us":2318,"threads_started":1}
I20260923 19:35:28.324652 14124 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:41545
I20260923 19:35:28.324687 14259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:41545 every 8 connection(s)
I20260923 19:35:28.326140 14124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:28.328403 14260 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33665
I20260923 19:35:28.328660 14260 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:28.329344 14260 heartbeater.cc:511] Master 127.12.159.254:33665 requested a full tablet report, sending...
I20260923 19:35:28.330619 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 14124
I20260923 19:35:28.330859 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:28.331657 12927 external_mini_cluster.cc:1428] Setting key 1b371cb80c68e13aad065854cc60985e
I20260923 19:35:28.331882 14053 ts_manager.cc:194] Registered new tserver with Master: 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193:41545)
I20260923 19:35:28.332998 14242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.317358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33665 (local address 127.12.159.193:50243)
0923 19:35:28.318121 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:28.318147 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:28.318597 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:28.319048 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:28.319051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:28.319505 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:28.319778 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.319787 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.321335 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.321342 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.323134 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.323146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.324278 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.324284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.324586 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.325336 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:28.325354 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:28.326267 (+ 913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:28.330102 (+ 3835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.330109 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.330113 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.330668 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.331162 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.331167 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.331171 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.331297 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.331895 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:28.331902 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:28.332099 (+ 197us) client_negotiation.cc:769] Sending connection context
0923 19:35:28.332227 (+ 128us) client_negotiation.cc:240] Negotiation successful
0923 19:35:28.332571 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":467,"threads_started":1}
I20260923 19:35:28.333782 14053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:41295
I20260923 19:35:28.334034 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.316832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:50243 (local address 127.12.159.254:33665)
0923 19:35:28.317025 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:28.317029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:28.318283 (+ 1254us) server_negotiation.cc:407] Connection header received
0923 19:35:28.318796 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:28.318804 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:28.318894 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:28.318999 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:28.319922 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.321185 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.323275 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.324020 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.324164 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.326457 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:28.326463 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:28.326469 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:28.326509 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:28.329973 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.330833 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.330838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.330841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.331037 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.331413 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.331418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.331421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.331704 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:28.333267 (+ 1563us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:28.333378 (+ 111us) server_negotiation.cc:299] Negotiation successful
0923 19:35:28.333627 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:28.372385 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33665
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:28.701031 14264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:28.701315 14264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:28.701412 14264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:28.708808 14264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:28.708922 14264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:28.709007 14264 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:35:28.709085 14264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:28.719136 14264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:33665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:28.720402 14264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:28.721717 14264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:28.735747 14270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:28.735786 14269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:28.736794 14272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:28.737838 14264 server_base.cc:1034] running on GCE node
I20260923 19:35:28.738551 14264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:28.739673 14264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:28.740914 14264 hybrid_clock.cc:648] HybridClock initialized: now 1790192128740827 us; error 66 us; skew 500 ppm
I20260923 19:35:28.741247 14264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:28 dist-test-slave-lzv7 krb5kdc[14008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:28.744969 14264 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:28.750066 14264 webserver.cc:460] Webserver started at http://127.12.159.194:32815/ using document root <none> and password file <none>
I20260923 19:35:28.750862 14264 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:28.750949 14264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:28.751216 14264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:28.754329 14264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea"
format_stamp: "Formatted at 2026-09-23 19:35:28 on dist-test-slave-lzv7"
server_key: "f72eb0a120ffe2500f4a0a81255ccc6f"
server_key_iv: "03a58ec33d0d4197e08c68eb33e66566"
server_key_version: "encryptionkey@0"
I20260923 19:35:28.755091 14264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea"
format_stamp: "Formatted at 2026-09-23 19:35:28 on dist-test-slave-lzv7"
server_key: "f72eb0a120ffe2500f4a0a81255ccc6f"
server_key_iv: "03a58ec33d0d4197e08c68eb33e66566"
server_key_version: "encryptionkey@0"
I20260923 19:35:28.760471 14264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:35:28.764427 14279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:28.766023 14264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:35:28.766161 14264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea"
format_stamp: "Formatted at 2026-09-23 19:35:28 on dist-test-slave-lzv7"
server_key: "f72eb0a120ffe2500f4a0a81255ccc6f"
server_key_iv: "03a58ec33d0d4197e08c68eb33e66566"
server_key_version: "encryptionkey@0"
I20260923 19:35:28.766359 14264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:28.788182 14264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:28.792776 14264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:28.793009 14264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:28.795611 14264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:28.795709 14264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:28.795876 14264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:28.795938 14264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:35:28 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192128, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:28.820415 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.796530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:48787 (local address 127.12.159.254:33665)
0923 19:35:28.796742 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:28.796751 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:28.798183 (+ 1432us) server_negotiation.cc:407] Connection header received
0923 19:35:28.800234 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:28.800241 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:28.800345 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:28.800467 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:28.802927 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.804249 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.806877 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.807574 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.807712 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.813048 (+ 5336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:28.813056 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:28.813061 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:28.813119 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:28.816573 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.817619 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.817624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.817626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.817747 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.818254 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.818261 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.818266 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.818651 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:28.818808 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:28.819835 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0923 19:35:28.820051 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260923 19:35:28.821517 14288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.797081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33665 (local address 127.12.159.194:48787)
0923 19:35:28.798008 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:28.798053 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:28.799942 (+ 1889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:28.800770 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:28.800784 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:28.801634 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:28.802651 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.802687 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.804446 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.804458 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.806711 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.806725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.807850 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.807857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.808257 (+ 400us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.809211 (+ 954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:28.809240 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:28.812661 (+ 3421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:28.816794 (+ 4133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.816805 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.816832 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.817446 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.817903 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.817908 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.817912 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.818127 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.818786 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:28.818794 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:28.819293 (+ 499us) client_negotiation.cc:769] Sending connection context
0923 19:35:28.819742 (+ 449us) client_negotiation.cc:240] Negotiation successful
0923 19:35:28.820326 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":388,"threads_started":1}
I20260923 19:35:28.850559 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.832302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:47245 (local address 127.12.159.254:33665)
0923 19:35:28.832546 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:28.832556 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:28.833157 (+ 601us) server_negotiation.cc:407] Connection header received
0923 19:35:28.833293 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:28.833299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:28.833390 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:28.833515 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:28.834859 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.836337 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.838217 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.838826 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.838937 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.842754 (+ 3817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:28.842763 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:28.842768 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:28.842818 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:28.846721 (+ 3903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.847827 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.847835 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.847841 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.848056 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:28.848639 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:28.848646 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:28.848651 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:28.849169 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:28.849956 (+ 787us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:28.850110 (+ 154us) server_negotiation.cc:299] Negotiation successful
0923 19:35:28.850277 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:35:28.850747 14378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:28.832352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33665 (local address 127.12.159.194:47245)
0923 19:35:28.833043 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:28.833059 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:28.833190 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:28.833550 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:28.833553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:28.834216 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:28.834663 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.834681 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.836488 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.836492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.837999 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:28.838019 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:28.839248 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:28.839256 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:28.839466 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:28.840555 (+ 1089us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:28.840584 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:28.841932 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:28.846870 (+ 4938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.846879 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.846886 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.847632 (+ 746us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.848240 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:28.848248 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:28.848254 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:28.848442 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:28.849358 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:28.849367 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:28.849641 (+ 274us) client_negotiation.cc:769] Sending connection context
0923 19:35:28.849773 (+ 132us) client_negotiation.cc:240] Negotiation successful
0923 19:35:28.850163 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":368,"threads_started":1}
I20260923 19:35:28.858522 14264 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:35873
I20260923 19:35:28.858554 14398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:35873 every 8 connection(s)
I20260923 19:35:28.859807 14264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:28.860311 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 14264
I20260923 19:35:28.860533 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:28.860972 12927 external_mini_cluster.cc:1428] Setting key dd049a8b0ad5c87a256020ab0f76e645
I20260923 19:35:28.862464 14399 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33665
I20260923 19:35:28.862782 14399 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:28.863637 14399 heartbeater.cc:511] Master 127.12.159.254:33665 requested a full tablet report, sending...
I20260923 19:35:28.865278 14053 ts_manager.cc:194] Registered new tserver with Master: b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873)
I20260923 19:35:28.866223 14053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:48787
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:28.902050 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33665
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:29.219496 14403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:29.219765 14403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:29.219861 14403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:29.227722 14403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:29.227826 14403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:29.227909 14403 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:35:29.227989 14403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:29.237397 14403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:33665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:29.238674 14403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:29.240037 14403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:29.253820 14409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:29.253854 14408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:29.253734 14411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:29.254781 14403 server_base.cc:1034] running on GCE node
I20260923 19:35:29.255507 14403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:29.256466 14403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:29.257709 14403 hybrid_clock.cc:648] HybridClock initialized: now 1790192129257626 us; error 60 us; skew 500 ppm
I20260923 19:35:29.258153 14403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:29 dist-test-slave-lzv7 krb5kdc[14008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:29.261268 14403 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:29.263034 14403 webserver.cc:460] Webserver started at http://127.12.159.195:46735/ using document root <none> and password file <none>
I20260923 19:35:29.263782 14403 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:29.263892 14403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:29.264232 14403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:29.267331 14403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "9aa06fc9f6584d0bb425fcfe5adff34f"
format_stamp: "Formatted at 2026-09-23 19:35:29 on dist-test-slave-lzv7"
server_key: "14538f4a60e58df81db31f667094988f"
server_key_iv: "f5d39e2cffc05e1f2068536b6f0a708d"
server_key_version: "encryptionkey@0"
I20260923 19:35:29.268133 14403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "9aa06fc9f6584d0bb425fcfe5adff34f"
format_stamp: "Formatted at 2026-09-23 19:35:29 on dist-test-slave-lzv7"
server_key: "14538f4a60e58df81db31f667094988f"
server_key_iv: "f5d39e2cffc05e1f2068536b6f0a708d"
server_key_version: "encryptionkey@0"
I20260923 19:35:29.273442 14403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:35:29.276832 14418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:29.278218 14403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:35:29.278384 14403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "9aa06fc9f6584d0bb425fcfe5adff34f"
format_stamp: "Formatted at 2026-09-23 19:35:29 on dist-test-slave-lzv7"
server_key: "14538f4a60e58df81db31f667094988f"
server_key_iv: "f5d39e2cffc05e1f2068536b6f0a708d"
server_key_version: "encryptionkey@0"
I20260923 19:35:29.278601 14403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:29.296499 14403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:29.300457 14403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:29.300727 14403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:29.303524 14403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:29.303630 14403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:29.303773 14403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:29.303876 14403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Sep 23 19:35:29 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192129, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:29.331785 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.304628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33665 (local address 127.12.159.195:56973)
0923 19:35:29.305412 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.305454 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.307477 (+ 2023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.308461 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.308478 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.309561 (+ 1083us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:29.310674 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.310704 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.312329 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.312334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.315608 (+ 3274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.315630 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.316628 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.316640 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.317066 (+ 426us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.317965 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:29.318009 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:29.321929 (+ 3920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:29.326862 (+ 4933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:29.326872 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:29.326888 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:29.327497 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:29.328019 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:29.328024 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:29.328027 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:29.328335 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:29.329152 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:29.329160 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:29.329626 (+ 466us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.329949 (+ 323us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.330576 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":345,"threads_started":1}
I20260923 19:35:29.332775 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.303952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:56973 (local address 127.12.159.254:33665)
0923 19:35:29.304175 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.304183 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.305586 (+ 1403us) server_negotiation.cc:407] Connection header received
0923 19:35:29.307902 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.307908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.308036 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.308158 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:29.310980 (+ 2822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.312163 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.315788 (+ 3625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.316324 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.316491 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.322277 (+ 5786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:29.322286 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:29.322293 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:29.322344 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:29.326679 (+ 4335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:29.327657 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:29.327666 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:29.327673 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:29.327870 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:29.328500 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:29.328508 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:29.328514 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:29.328994 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:29.329175 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.332353 (+ 3178us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.332542 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 19:35:29.337280 14260 heartbeater.cc:503] Master 127.12.159.254:33665 was elected leader, sending a full tablet report...
I20260923 19:35:29.354598 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.339486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:57515 (local address 127.12.159.254:33665)
0923 19:35:29.339674 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.339681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.340316 (+ 635us) server_negotiation.cc:407] Connection header received
0923 19:35:29.340506 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.340512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.340595 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.340700 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:29.342311 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.343031 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.344405 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.344822 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.344961 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.347249 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:29.347258 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:29.347264 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:29.347314 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:29.351166 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:29.352254 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:29.352262 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:29.352267 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:29.352455 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:29.352872 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:29.352875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:29.352877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:29.353188 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:29.353306 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.353929 (+ 623us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.354235 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:35:29.354975 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.339545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33665 (local address 127.12.159.195:57515)
0923 19:35:29.340208 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.340235 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.340390 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.340730 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.340735 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.341487 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:29.342146 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.342162 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.343174 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.343182 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.344258 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.344270 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.345013 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.345019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.345186 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.345982 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:29.346010 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:29.347058 (+ 1048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:29.351358 (+ 4300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:29.351367 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:29.351373 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:29.352112 (+ 739us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:29.352590 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:29.352595 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:29.352606 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:29.352754 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:29.353308 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:29.353314 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:29.353529 (+ 215us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.353786 (+ 257us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.354281 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":385,"threads_started":1}
I20260923 19:35:29.365756 14403 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:41757
I20260923 19:35:29.365778 14537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:41757 every 8 connection(s)
I20260923 19:35:29.367022 14403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:29.369165 14538 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33665
I20260923 19:35:29.369412 14538 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:29.369408 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 14403
I20260923 19:35:29.369601 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:29.370180 12927 external_mini_cluster.cc:1428] Setting key 3e79a5604acfa7d23799354c5abeb2a5
I20260923 19:35:29.370234 14538 heartbeater.cc:511] Master 127.12.159.254:33665 requested a full tablet report, sending...
I20260923 19:35:29.371588 14053 ts_manager.cc:194] Registered new tserver with Master: 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757)
I20260923 19:35:29.372691 14053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:56973
I20260923 19:35:29.373342 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:35:29 dist-test-slave-lzv7 krb5kdc[14008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192129, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:35:29 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192129, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:29.419781 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.405427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38490 (local address 127.12.159.254:33665)
0923 19:35:29.405673 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.405681 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.406034 (+ 353us) server_negotiation.cc:407] Connection header received
0923 19:35:29.406268 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.406272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.406339 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.406470 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:29.407916 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.408699 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.410094 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.410508 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.410650 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.414591 (+ 3941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:29.414596 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:29.414600 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:29.414641 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:29.417063 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:29.417735 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:29.417740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:29.417742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:29.417923 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:29.418328 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:29.418333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:29.418336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:29.418609 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:29.418870 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.419182 (+ 312us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.419430 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:35:29.423923 14053 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38490:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:29.430928 14053 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:29.455883 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.442789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:41757 (local address 127.0.0.1:36356)
0923 19:35:29.443509 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.443594 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.443766 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.444826 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.444838 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.444880 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:29.445354 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.445370 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.448172 (+ 2802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.448181 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.451470 (+ 3289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.451494 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.454565 (+ 3071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.454577 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.454840 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.454928 (+ 88us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.455100 (+ 172us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.455347 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":308,"threads_started":1}
I20260923 19:35:29.456847 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.443083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36356 (local address 127.12.159.195:41757)
0923 19:35:29.443800 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.443809 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.443844 (+ 35us) server_negotiation.cc:407] Connection header received
0923 19:35:29.443947 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.443955 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.444217 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.444412 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:29.445675 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.447958 (+ 2283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.451755 (+ 3797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.453889 (+ 2134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.454145 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.454419 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.456198 (+ 1779us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.456428 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":374,"threads_started":1}
I20260923 19:35:29.462494 14468 tablet_service.cc:1467] Processing CreateTablet for tablet 955ff520d4514d768badecc666374e01 (DEFAULT_TABLE table=test-table [id=d53b866aef774f76a4a11387bb33014b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:29.464212 14468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955ff520d4514d768badecc666374e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:29.464313 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.444313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41545 (local address 127.0.0.1:49442)
0923 19:35:29.457172 (+ 12859us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.457194 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.457311 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.458519 (+ 1208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.458523 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.458549 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:29.458822 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.458841 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.460243 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.460250 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.461973 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.461984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.463481 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.463489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.463665 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.463697 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.463796 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.463946 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12768,"mutex_wait_us":52,"thread_start_us":12994,"threads_started":1}
I20260923 19:35:29.464280 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.444891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49442 (local address 127.12.159.193:41545)
0923 19:35:29.457991 (+ 13100us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.458000 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.458025 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:35:29.458106 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.458112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.458303 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.458810 (+ 507us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:29.459020 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.460098 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.462120 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.463314 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.463502 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.463690 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.463845 (+ 155us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.463995 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12940,"thread_start_us":12785,"threads_started":1}
I20260923 19:35:29.466918 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.443937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:35873 (local address 127.0.0.1:34570)
0923 19:35:29.457053 (+ 13116us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.457078 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.457233 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.458643 (+ 1410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.458647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.458676 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:29.459149 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.459160 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.461841 (+ 2681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.461846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.463919 (+ 2073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.463934 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.466038 (+ 2104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.466042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.466249 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.466283 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.466387 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.466538 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12959,"mutex_wait_us":3,"thread_start_us":13404,"threads_started":1}
I20260923 19:35:29.466982 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.444371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34570 (local address 127.12.159.194:35873)
0923 19:35:29.457089 (+ 12718us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.457109 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.457147 (+ 38us) server_negotiation.cc:407] Connection header received
0923 19:35:29.457900 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.457909 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.458216 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.458448 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:29.459371 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.461652 (+ 2281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.464105 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.465494 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.465696 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.465913 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.466469 (+ 556us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.466660 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12521,"thread_start_us":13170,"threads_started":1}
I20260923 19:35:29.469800 14190 tablet_service.cc:1467] Processing CreateTablet for tablet 955ff520d4514d768badecc666374e01 (DEFAULT_TABLE table=test-table [id=d53b866aef774f76a4a11387bb33014b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:29.470548 14329 tablet_service.cc:1467] Processing CreateTablet for tablet 955ff520d4514d768badecc666374e01 (DEFAULT_TABLE table=test-table [id=d53b866aef774f76a4a11387bb33014b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:29.471416 14190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955ff520d4514d768badecc666374e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:29.472016 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955ff520d4514d768badecc666374e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:29.479828 14557 tablet_bootstrap.cc:492] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Bootstrap starting.
I20260923 19:35:29.483888 14557 tablet_bootstrap.cc:654] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:29.484910 14557 log.cc:824] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:29.487982 14557 tablet_bootstrap.cc:492] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: No bootstrap required, opened a new log
I20260923 19:35:29.488394 14557 ts_tablet_manager.cc:1397] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260923 19:35:29.492820 14560 tablet_bootstrap.cc:492] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Bootstrap starting.
I20260923 19:35:29.492820 14559 tablet_bootstrap.cc:492] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Bootstrap starting.
I20260923 19:35:29.496711 14559 tablet_bootstrap.cc:654] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:29.496717 14560 tablet_bootstrap.cc:654] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:29.497262 14557 raft_consensus.cc:348] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.497851 14557 raft_consensus.cc:374] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:29.498008 14557 raft_consensus.cc:729] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa06fc9f6584d0bb425fcfe5adff34f, State: Initialized, Role: FOLLOWER
I20260923 19:35:29.498109 14559 log.cc:824] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:29.498111 14560 log.cc:824] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:29.498798 14557 consensus_queue.cc:260] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.500635 14557 ts_tablet_manager.cc:1428] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Time spent starting tablet: real 0.012s user 0.000s sys 0.010s
I20260923 19:35:29.501075 14538 heartbeater.cc:503] Master 127.12.159.254:33665 was elected leader, sending a full tablet report...
I20260923 19:35:29.501212 14560 tablet_bootstrap.cc:492] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: No bootstrap required, opened a new log
I20260923 19:35:29.501302 14559 tablet_bootstrap.cc:492] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: No bootstrap required, opened a new log
I20260923 19:35:29.501564 14560 ts_tablet_manager.cc:1397] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260923 19:35:29.501564 14559 ts_tablet_manager.cc:1397] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260923 19:35:29.510143 14559 raft_consensus.cc:348] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.510536 14559 raft_consensus.cc:374] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:29.510660 14559 raft_consensus.cc:729] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3556b1a6e1b45ed8ea5679d4888d9ea, State: Initialized, Role: FOLLOWER
I20260923 19:35:29.511016 14560 raft_consensus.cc:348] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.511373 14560 raft_consensus.cc:374] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:29.511273 14559 consensus_queue.cc:260] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.511505 14560 raft_consensus.cc:729] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf4e332e0424d32922a03c038ba37d9, State: Initialized, Role: FOLLOWER
I20260923 19:35:29.512246 14560 consensus_queue.cc:260] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.512424 14399 heartbeater.cc:503] Master 127.12.159.254:33665 was elected leader, sending a full tablet report...
I20260923 19:35:29.513015 14559 ts_tablet_manager.cc:1428] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260923 19:35:29.513976 14560 ts_tablet_manager.cc:1428] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Time spent starting tablet: real 0.012s user 0.001s sys 0.012s
W20260923 19:35:29.578658 14261 tablet.cc:2369] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:35:29.613155 14400 tablet.cc:2369] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:35:29.618568 14539 tablet.cc:2369] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:35:29.791591 14565 raft_consensus.cc:482] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:29.791960 14565 raft_consensus.cc:504] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.793615 14565 leader_election.cc:288] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757), b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873)
I20260923 19:35:29.796733 14563 raft_consensus.cc:482] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:29.797047 14563 raft_consensus.cc:504] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.798875 14563 leader_election.cc:288] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873), 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193:41545)
I20260923 19:35:29.802766 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.795141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:37063 (local address 127.12.159.194:35873)
0923 19:35:29.795332 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.795337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.795587 (+ 250us) server_negotiation.cc:407] Connection header received
0923 19:35:29.795699 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.795706 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.795786 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.795880 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:29.796448 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.797510 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.800173 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.801459 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.801688 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.801794 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.802328 (+ 534us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.802479 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":69}
I20260923 19:35:29.803000 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.794110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:41171 (local address 127.12.159.195:41757)
0923 19:35:29.794346 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.794354 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.795008 (+ 654us) server_negotiation.cc:407] Connection header received
0923 19:35:29.795255 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.795261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.795337 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.795415 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:29.796251 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.797213 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.800382 (+ 3169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.801761 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.801919 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.801987 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.802534 (+ 547us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.802725 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260923 19:35:29.803550 14567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.794851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:35873 (local address 127.12.159.193:37063)
0923 19:35:29.795476 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.795490 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.795592 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.795903 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.795906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.795923 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:29.796269 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.796277 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.797672 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.797677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.799865 (+ 2188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.799886 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.801842 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.801849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.802102 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.802161 (+ 59us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.802936 (+ 775us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.803121 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":1,"thread_start_us":368,"threads_started":1}
I20260923 19:35:29.804090 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.794092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:41757 (local address 127.12.159.193:41171)
0923 19:35:29.794744 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.794760 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.795048 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.795618 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.795626 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.795657 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:29.796083 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.796095 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.797338 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.797346 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.800223 (+ 2877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.800236 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.802195 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.802201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.802362 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.802392 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.803449 (+ 1057us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.803619 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":452,"thread_start_us":370,"threads_started":1}
I20260923 19:35:29.804720 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" is_pre_election: true
I20260923 19:35:29.805094 14493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" is_pre_election: true
I20260923 19:35:29.805315 14349 raft_consensus.cc:2454] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 0.
I20260923 19:35:29.805540 14493 raft_consensus.cc:2454] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 0.
I20260923 19:35:29.806113 14141 leader_election.cc:302] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf4e332e0424d32922a03c038ba37d9, b3556b1a6e1b45ed8ea5679d4888d9ea; no voters:
I20260923 19:35:29.806623 14565 raft_consensus.cc:2781] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:29.806818 14565 raft_consensus.cc:482] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:29.806922 14565 raft_consensus.cc:3037] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:29.808018 14427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.799174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:35873 (local address 127.12.159.195:36407)
0923 19:35:29.799477 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.799498 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.799606 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.800857 (+ 1251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.800865 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.800906 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:29.801224 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.801238 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.803439 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.803444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.805508 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.805526 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.807235 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.807240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.807465 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.807499 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.807605 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.807746 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176}
I20260923 19:35:29.808132 14569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.799892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:36407 (local address 127.12.159.194:35873)
0923 19:35:29.800539 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.800549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.800577 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:35:29.800632 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.800636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.800705 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.801376 (+ 671us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:29.801934 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.803243 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.805704 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.807065 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.807256 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.807335 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.807653 (+ 318us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.807801 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":273,"server-negotiator.queue_time_us":525,"thread_start_us":1683,"threads_started":1}
I20260923 19:35:29.808789 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.799691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:58087 (local address 127.12.159.193:41545)
0923 19:35:29.799914 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.799920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.800205 (+ 285us) server_negotiation.cc:407] Connection header received
0923 19:35:29.800439 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.800445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.800510 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.800563 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:29.801443 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.802582 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.806378 (+ 3796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.807677 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.807830 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.807902 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.808429 (+ 527us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.808556 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:35:29.808851 14568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.799368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41545 (local address 127.12.159.195:58087)
0923 19:35:29.800117 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:29.800135 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:29.800302 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:29.800731 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:29.800736 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:29.800765 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:29.801265 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.801276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.802777 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.802783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.806173 (+ 3390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:29.806186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.808052 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.808058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:29.808250 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.808286 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 19:35:29.808403 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 19:35:29.808537 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":562,"threads_started":1}
I20260923 19:35:29.808938 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" is_pre_election: true
I20260923 19:35:29.809181 14349 raft_consensus.cc:2454] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aa06fc9f6584d0bb425fcfe5adff34f in term 0.
I20260923 19:35:29.809696 14420 leader_election.cc:302] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9aa06fc9f6584d0bb425fcfe5adff34f, b3556b1a6e1b45ed8ea5679d4888d9ea; no voters:
I20260923 19:35:29.810132 14563 raft_consensus.cc:2781] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:29.810297 14563 raft_consensus.cc:482] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:29.810418 14563 raft_consensus.cc:3037] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:29.810281 14565 raft_consensus.cc:504] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.810304 14210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf4e332e0424d32922a03c038ba37d9" is_pre_election: true
I20260923 19:35:29.810793 14210 raft_consensus.cc:2379] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9aa06fc9f6584d0bb425fcfe5adff34f in current term 1: Already voted for candidate 4cf4e332e0424d32922a03c038ba37d9 in this term.
I20260923 19:35:29.811060 14565 leader_election.cc:288] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 election: Requested vote from peers 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757), b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873)
I20260923 19:35:29.811578 14493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f"
I20260923 19:35:29.811630 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea"
I20260923 19:35:29.811827 14349 raft_consensus.cc:3037] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:29.813171 14563 raft_consensus.cc:504] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.813557 14493 raft_consensus.cc:2379] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf4e332e0424d32922a03c038ba37d9 in current term 1: Already voted for candidate 9aa06fc9f6584d0bb425fcfe5adff34f in this term.
I20260923 19:35:29.813917 14563 leader_election.cc:288] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [CANDIDATE]: Term 1 election: Requested vote from peers b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873), 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193:41545)
I20260923 19:35:29.814471 14349 raft_consensus.cc:2454] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 1.
I20260923 19:35:29.814481 14210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf4e332e0424d32922a03c038ba37d9"
I20260923 19:35:29.814734 14210 raft_consensus.cc:2379] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9aa06fc9f6584d0bb425fcfe5adff34f in current term 1: Already voted for candidate 4cf4e332e0424d32922a03c038ba37d9 in this term.
I20260923 19:35:29.814916 14141 leader_election.cc:302] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf4e332e0424d32922a03c038ba37d9, b3556b1a6e1b45ed8ea5679d4888d9ea; no voters:
I20260923 19:35:29.815205 14565 raft_consensus.cc:2781] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:29.815593 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955ff520d4514d768badecc666374e01" candidate_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea"
I20260923 19:35:29.815685 14565 raft_consensus.cc:686] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf4e332e0424d32922a03c038ba37d9, State: Running, Role: LEADER
I20260923 19:35:29.816190 14349 raft_consensus.cc:2379] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9aa06fc9f6584d0bb425fcfe5adff34f in current term 1: Already voted for candidate 4cf4e332e0424d32922a03c038ba37d9 in this term.
I20260923 19:35:29.816161 14565 consensus_queue.cc:237] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } }
I20260923 19:35:29.816780 14420 leader_election.cc:302] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa06fc9f6584d0bb425fcfe5adff34f; no voters: 4cf4e332e0424d32922a03c038ba37d9, b3556b1a6e1b45ed8ea5679d4888d9ea
I20260923 19:35:29.817140 14563 raft_consensus.cc:2726] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260923 19:35:29.821058 14053 catalog_manager.cc:5495] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260923 19:35:29.928627 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:29.922855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49456 (local address 127.12.159.193:41545)
0923 19:35:29.923025 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:29.923030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:29.923481 (+ 451us) server_negotiation.cc:407] Connection header received
0923 19:35:29.923775 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:29.923779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:29.923866 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:29.924029 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:29.924454 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.925306 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.926660 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:29.927039 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:29.927140 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:29.927570 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:29.928087 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:29.928212 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:29.928322 (+ 110us) server_negotiation.cc:299] Negotiation successful
0923 19:35:29.928389 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:35:29.936991 14493 raft_consensus.cc:1261] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Refusing update from remote peer 4cf4e332e0424d32922a03c038ba37d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:29.936970 14349 raft_consensus.cc:1261] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Refusing update from remote peer 4cf4e332e0424d32922a03c038ba37d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:29.937884 14570 consensus_queue.cc:1035] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:29.938302 14565 consensus_queue.cc:1035] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:29.949999 14575 mvcc.cc:205] Tried to move back new op lower bound from 7332626964211466240 to 7332626963731574784. Current Snapshot: MvccSnapshot[applied={T|T < 7332626964211466240}]
I20260923 19:35:29.967573 14052 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:29.967864 14052 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:29.971698 14052 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045: Sending DeleteTablet for 3 replicas of tablet 955ff520d4514d768badecc666374e01
I20260923 19:35:29.973050 14190 tablet_service.cc:1514] Processing DeleteTablet for tablet 955ff520d4514d768badecc666374e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:29 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:49442
I20260923 19:35:29.973356 14468 tablet_service.cc:1514] Processing DeleteTablet for tablet 955ff520d4514d768badecc666374e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:29 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:36356
I20260923 19:35:29.974133 14329 tablet_service.cc:1514] Processing DeleteTablet for tablet 955ff520d4514d768badecc666374e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:29 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:34570
I20260923 19:35:29.974565 14052 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38490:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:29.975471 14052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:29.983735 14189 tablet_service.cc:1467] Processing CreateTablet for tablet 0248def9c64845a89ebfc4df2d569236 (DEFAULT_TABLE table=test-table [id=4aa780ed0038461b8b7227f9fa218753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:29.984416 14189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0248def9c64845a89ebfc4df2d569236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:29.985555 14586 tablet_replica.cc:330] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: stopping tablet replica
I20260923 19:35:29.986217 14586 raft_consensus.cc:2229] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:29.987013 14585 tablet_replica.cc:330] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: stopping tablet replica
I20260923 19:35:29.987478 14586 raft_consensus.cc:2258] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:29.988265 14468 tablet_service.cc:1467] Processing CreateTablet for tablet 0248def9c64845a89ebfc4df2d569236 (DEFAULT_TABLE table=test-table [id=4aa780ed0038461b8b7227f9fa218753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:29.988395 14329 tablet_service.cc:1467] Processing CreateTablet for tablet 0248def9c64845a89ebfc4df2d569236 (DEFAULT_TABLE table=test-table [id=4aa780ed0038461b8b7227f9fa218753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:29.988736 14468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0248def9c64845a89ebfc4df2d569236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:29.988843 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0248def9c64845a89ebfc4df2d569236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:29.990058 14586 ts_tablet_manager.cc:1905] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:29.995862 14559 tablet_bootstrap.cc:492] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: Bootstrap starting.
I20260923 19:35:29.997285 14586 ts_tablet_manager.cc:1918] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:29.997442 14586 log.cc:1196] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/955ff520d4514d768badecc666374e01
I20260923 19:35:29.997682 14559 tablet_bootstrap.cc:654] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:29.998031 14585 raft_consensus.cc:2229] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:29.998554 14585 raft_consensus.cc:2258] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:29.999373 14560 tablet_bootstrap.cc:492] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: Bootstrap starting.
I20260923 19:35:30.001169 14560 tablet_bootstrap.cc:654] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:30.001297 14557 tablet_bootstrap.cc:492] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: Bootstrap starting.
I20260923 19:35:30.002952 14585 ts_tablet_manager.cc:1905] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:30.003144 14557 tablet_bootstrap.cc:654] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:30.004467 14584 tablet_replica.cc:330] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: stopping tablet replica
I20260923 19:35:30.004945 14584 raft_consensus.cc:2229] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:30.005867 14584 raft_consensus.cc:2258] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:30.008356 14584 ts_tablet_manager.cc:1905] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:30.013381 14557 tablet_bootstrap.cc:492] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: No bootstrap required, opened a new log
I20260923 19:35:30.013610 14557 ts_tablet_manager.cc:1397] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260923 19:35:30.014555 14557 raft_consensus.cc:348] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.014923 14557 raft_consensus.cc:374] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:30.015060 14557 raft_consensus.cc:729] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa06fc9f6584d0bb425fcfe5adff34f, State: Initialized, Role: FOLLOWER
I20260923 19:35:30.015506 14559 tablet_bootstrap.cc:492] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: No bootstrap required, opened a new log
I20260923 19:35:30.015448 14557 consensus_queue.cc:260] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.015779 14559 ts_tablet_manager.cc:1397] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.010s
I20260923 19:35:30.016691 14584 ts_tablet_manager.cc:1918] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:30.016907 14584 log.cc:1196] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/955ff520d4514d768badecc666374e01
I20260923 19:35:30.016858 14559 raft_consensus.cc:348] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.017549 14584 ts_tablet_manager.cc:1939] T 955ff520d4514d768badecc666374e01 P 4cf4e332e0424d32922a03c038ba37d9: Deleting consensus metadata
I20260923 19:35:30.017678 14559 raft_consensus.cc:374] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:30.017892 14559 raft_consensus.cc:729] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3556b1a6e1b45ed8ea5679d4888d9ea, State: Initialized, Role: FOLLOWER
I20260923 19:35:30.018363 14559 consensus_queue.cc:260] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.019515 14557 ts_tablet_manager.cc:1428] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260923 19:35:30.020109 14040 catalog_manager.cc:4841] TS 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193:41545): tablet 955ff520d4514d768badecc666374e01 (table test-table [id=d53b866aef774f76a4a11387bb33014b]) successfully deleted
I20260923 19:35:30.021588 14559 ts_tablet_manager.cc:1428] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:35:30.023370 14560 tablet_bootstrap.cc:492] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: No bootstrap required, opened a new log
I20260923 19:35:30.023591 14560 ts_tablet_manager.cc:1397] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.008s
I20260923 19:35:30.024756 14560 raft_consensus.cc:348] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.025074 14560 raft_consensus.cc:374] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:30.025221 14560 raft_consensus.cc:729] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf4e332e0424d32922a03c038ba37d9, State: Initialized, Role: FOLLOWER
I20260923 19:35:30.025612 14560 consensus_queue.cc:260] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.026168 14585 ts_tablet_manager.cc:1918] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:30.026360 14585 log.cc:1196] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/955ff520d4514d768badecc666374e01
I20260923 19:35:30.026547 14586 ts_tablet_manager.cc:1939] T 955ff520d4514d768badecc666374e01 P b3556b1a6e1b45ed8ea5679d4888d9ea: Deleting consensus metadata
I20260923 19:35:30.026906 14585 ts_tablet_manager.cc:1939] T 955ff520d4514d768badecc666374e01 P 9aa06fc9f6584d0bb425fcfe5adff34f: Deleting consensus metadata
I20260923 19:35:30.028446 14038 catalog_manager.cc:4841] TS b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873): tablet 955ff520d4514d768badecc666374e01 (table test-table [id=d53b866aef774f76a4a11387bb33014b]) successfully deleted
I20260923 19:35:30.028704 14038 catalog_manager.cc:4841] TS 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757): tablet 955ff520d4514d768badecc666374e01 (table test-table [id=d53b866aef774f76a4a11387bb33014b]) successfully deleted
I20260923 19:35:30.028824 14560 ts_tablet_manager.cc:1428] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:35:30.045411 14579 raft_consensus.cc:482] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:30.045737 14579 raft_consensus.cc:504] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.046696 14579 leader_election.cc:288] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873), 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757)
I20260923 19:35:30.047375 14493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0248def9c64845a89ebfc4df2d569236" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" is_pre_election: true
I20260923 19:35:30.047513 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0248def9c64845a89ebfc4df2d569236" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" is_pre_election: true
I20260923 19:35:30.047665 14493 raft_consensus.cc:2454] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 0.
I20260923 19:35:30.047811 14349 raft_consensus.cc:2454] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 0.
I20260923 19:35:30.048198 14141 leader_election.cc:302] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf4e332e0424d32922a03c038ba37d9, 9aa06fc9f6584d0bb425fcfe5adff34f; no voters:
I20260923 19:35:30.048528 14579 raft_consensus.cc:2781] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:30.048684 14579 raft_consensus.cc:482] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:30.048828 14579 raft_consensus.cc:3037] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:30.051467 14579 raft_consensus.cc:504] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.052151 14579 leader_election.cc:288] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 election: Requested vote from peers b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873), 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757)
I20260923 19:35:30.052660 14493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0248def9c64845a89ebfc4df2d569236" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f"
I20260923 19:35:30.052639 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0248def9c64845a89ebfc4df2d569236" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea"
I20260923 19:35:30.052887 14349 raft_consensus.cc:3037] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:30.052903 14493 raft_consensus.cc:3037] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:30.056418 14349 raft_consensus.cc:2454] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 1.
I20260923 19:35:30.056396 14493 raft_consensus.cc:2454] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 1.
I20260923 19:35:30.057001 14141 leader_election.cc:302] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf4e332e0424d32922a03c038ba37d9, 9aa06fc9f6584d0bb425fcfe5adff34f; no voters:
I20260923 19:35:30.057722 14579 raft_consensus.cc:2781] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:30.057932 14579 raft_consensus.cc:686] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf4e332e0424d32922a03c038ba37d9, State: Running, Role: LEADER
I20260923 19:35:30.058308 14579 consensus_queue.cc:237] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.061342 14052 catalog_manager.cc:5495] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } health_report { overall_health: UNKNOWN } } }
Sep 23 19:35:30 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192127, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:30.124080 14597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.100325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33665 (local address 127.0.0.1:38502)
0923 19:35:30.101199 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:30.101226 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:30.101406 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:30.101776 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:30.101782 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:30.102775 (+ 993us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:30.103114 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:30.103127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.104286 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.104293 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:30.105928 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:30.105944 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.106694 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.106701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:30.106881 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.114332 (+ 7451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:30.114361 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:30.117184 (+ 2823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:30.121282 (+ 4098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:30.121294 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:30.121302 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:30.121767 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:30.122257 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:30.122261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:30.122263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:30.122393 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:30.123024 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:30.123030 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:30.123381 (+ 351us) client_negotiation.cc:769] Sending connection context
0923 19:35:30.123539 (+ 158us) client_negotiation.cc:240] Negotiation successful
0923 19:35:30.123764 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":561,"threads_started":1}
I20260923 19:35:30.124481 14596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.100327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38502 (local address 127.12.159.254:33665)
0923 19:35:30.101069 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.101075 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.101333 (+ 258us) server_negotiation.cc:407] Connection header received
0923 19:35:30.101550 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.101553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.101626 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.101735 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:30.103281 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.104134 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.106058 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.106502 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.106622 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.117440 (+ 10818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:30.117447 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:30.117453 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:30.117495 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:30.121101 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.121966 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.121972 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.121975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.122125 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.122510 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.122515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.122519 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.122883 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:30.123047 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.123677 (+ 630us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.123918 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":315,"threads_started":1}
I20260923 19:35:30.130093 14052 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:38502:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 19:35:30.131101 14052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:30.137672 14190 tablet_service.cc:1467] Processing CreateTablet for tablet b4180184c5684c67a1260528a4cebfff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b99d2a636be45f2bf00cc481a17aec6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:35:30.137650 14329 tablet_service.cc:1467] Processing CreateTablet for tablet b4180184c5684c67a1260528a4cebfff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b99d2a636be45f2bf00cc481a17aec6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:35:30.138278 14190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4180184c5684c67a1260528a4cebfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:30.138276 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4180184c5684c67a1260528a4cebfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:30.143280 14468 tablet_service.cc:1467] Processing CreateTablet for tablet b4180184c5684c67a1260528a4cebfff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b99d2a636be45f2bf00cc481a17aec6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:35:30.143829 14468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4180184c5684c67a1260528a4cebfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:30.145424 14560 tablet_bootstrap.cc:492] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: Bootstrap starting.
I20260923 19:35:30.147220 14560 tablet_bootstrap.cc:654] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:30.148193 14559 tablet_bootstrap.cc:492] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: Bootstrap starting.
I20260923 19:35:30.149885 14559 tablet_bootstrap.cc:654] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:30.151739 14557 tablet_bootstrap.cc:492] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: Bootstrap starting.
I20260923 19:35:30.153976 14557 tablet_bootstrap.cc:654] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:30.159811 14560 tablet_bootstrap.cc:492] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: No bootstrap required, opened a new log
I20260923 19:35:30.160048 14560 ts_tablet_manager.cc:1397] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.003s
I20260923 19:35:30.161185 14560 raft_consensus.cc:348] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.161506 14560 raft_consensus.cc:374] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:30.161600 14560 raft_consensus.cc:729] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf4e332e0424d32922a03c038ba37d9, State: Initialized, Role: FOLLOWER
I20260923 19:35:30.161962 14560 consensus_queue.cc:260] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.162429 14579 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.162737 14579 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:30.163116 14557 tablet_bootstrap.cc:492] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: No bootstrap required, opened a new log
I20260923 19:35:30.163254 14560 ts_tablet_manager.cc:1428] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260923 19:35:30.163288 14557 ts_tablet_manager.cc:1397] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260923 19:35:30.164029 14557 raft_consensus.cc:348] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.164295 14557 raft_consensus.cc:374] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:30.164383 14557 raft_consensus.cc:729] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa06fc9f6584d0bb425fcfe5adff34f, State: Initialized, Role: FOLLOWER
I20260923 19:35:30.164674 14557 consensus_queue.cc:260] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.165069 14563 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.165366 14563 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:30.165400 14559 tablet_bootstrap.cc:492] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: No bootstrap required, opened a new log
I20260923 19:35:30.165643 14559 ts_tablet_manager.cc:1397] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.001s
I20260923 19:35:30.166492 14559 raft_consensus.cc:348] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.166790 14559 raft_consensus.cc:374] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:30.167220 14559 raft_consensus.cc:729] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3556b1a6e1b45ed8ea5679d4888d9ea, State: Initialized, Role: FOLLOWER
I20260923 19:35:30.167603 14559 consensus_queue.cc:260] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.168045 14557 ts_tablet_manager.cc:1428] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260923 19:35:30.168442 14559 ts_tablet_manager.cc:1428] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:30.168282 14564 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.168668 14564 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:30.185241 14579 raft_consensus.cc:482] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:30.185461 14579 raft_consensus.cc:504] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.186264 14579 leader_election.cc:288] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873), 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757)
I20260923 19:35:30.186879 14493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4180184c5684c67a1260528a4cebfff" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" is_pre_election: true
I20260923 19:35:30.186839 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4180184c5684c67a1260528a4cebfff" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" is_pre_election: true
I20260923 19:35:30.187116 14349 raft_consensus.cc:2454] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 0.
I20260923 19:35:30.187116 14493 raft_consensus.cc:2454] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 0.
I20260923 19:35:30.187516 14141 leader_election.cc:302] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf4e332e0424d32922a03c038ba37d9, 9aa06fc9f6584d0bb425fcfe5adff34f; no voters:
I20260923 19:35:30.187892 14579 raft_consensus.cc:2781] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:30.188026 14579 raft_consensus.cc:482] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:30.188145 14579 raft_consensus.cc:3037] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:30.190331 14579 raft_consensus.cc:504] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.190888 14579 leader_election.cc:288] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 election: Requested vote from peers b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873), 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757)
I20260923 19:35:30.191427 14493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4180184c5684c67a1260528a4cebfff" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f"
I20260923 19:35:30.191624 14493 raft_consensus.cc:3037] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:30.193766 14493 raft_consensus.cc:2454] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 1.
I20260923 19:35:30.194170 14349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4180184c5684c67a1260528a4cebfff" candidate_uuid: "4cf4e332e0424d32922a03c038ba37d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea"
I20260923 19:35:30.194221 14141 leader_election.cc:302] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf4e332e0424d32922a03c038ba37d9, 9aa06fc9f6584d0bb425fcfe5adff34f; no voters:
I20260923 19:35:30.194420 14349 raft_consensus.cc:3037] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:30.194494 14579 raft_consensus.cc:2781] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:30.194960 14579 raft_consensus.cc:686] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf4e332e0424d32922a03c038ba37d9, State: Running, Role: LEADER
I20260923 19:35:30.195272 14579 consensus_queue.cc:237] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } }
I20260923 19:35:30.196915 14570 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: TxnStatusTablet state changed. Reason: New leader 4cf4e332e0424d32922a03c038ba37d9. Latest consensus state: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.197355 14570 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:35:30.197353 14349 raft_consensus.cc:2454] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf4e332e0424d32922a03c038ba37d9 in term 1.
I20260923 19:35:30.198375 14602 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 19:35:30.198602 14602 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 19:35:30.198872 14052 catalog_manager.cc:5495] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260923 19:35:30.217341 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.212377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49466 (local address 127.12.159.193:41545)
0923 19:35:30.212567 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.212573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.212720 (+ 147us) server_negotiation.cc:407] Connection header received
0923 19:35:30.213008 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.213013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.213094 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.213193 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:30.213533 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.214365 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.215617 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.216045 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.216186 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.216607 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:30.216707 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:30.216803 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.216960 (+ 157us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.217032 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 19:35:30.217374 14597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.212168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41545 (local address 127.0.0.1:49466)
0923 19:35:30.212634 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:30.212649 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:30.212807 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:30.213218 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:30.213223 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:30.213235 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:35:30.213398 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:30.213406 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.214497 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.214505 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:30.215479 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:30.215489 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.216197 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.216202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:30.216379 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.216431 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:35:30.216805 (+ 374us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:35:30.216833 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 19:35:30.216928 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 19:35:30.217072 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296}
I20260923 19:35:30.220818 14493 raft_consensus.cc:1261] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Refusing update from remote peer 4cf4e332e0424d32922a03c038ba37d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:30.220980 14349 raft_consensus.cc:1261] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Refusing update from remote peer 4cf4e332e0424d32922a03c038ba37d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:30.221468 14570 consensus_queue.cc:1035] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:30.221755 14579 consensus_queue.cc:1035] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:30.224777 14563 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: TxnStatusTablet state changed. Reason: New leader 4cf4e332e0424d32922a03c038ba37d9. Latest consensus state: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.225092 14563 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:30.225613 14564 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: TxnStatusTablet state changed. Reason: New leader 4cf4e332e0424d32922a03c038ba37d9. Latest consensus state: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.225999 14564 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:30.228170 14579 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.228994 14564 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.229143 14579 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:35:30.229209 14564 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P b3556b1a6e1b45ed8ea5679d4888d9ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:30.229138 14574 mvcc.cc:205] Tried to move back new op lower bound from 7332626965378801664 to 7332626965282357248. Current Snapshot: MvccSnapshot[applied={T|T < 7332626965378801664}]
I20260923 19:35:30.229764 14570 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.230000 14570 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P 4cf4e332e0424d32922a03c038ba37d9: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:35:30.234902 14563 tablet_replica.cc:439] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4cf4e332e0424d32922a03c038ba37d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf4e332e0424d32922a03c038ba37d9" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41545 } } peers { permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 } } peers { permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 } } }
I20260923 19:35:30.235190 14563 tablet_replica.cc:442] T b4180184c5684c67a1260528a4cebfff P 9aa06fc9f6584d0bb425fcfe5adff34f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:30.256573 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.245845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:36547 (local address 127.12.159.193:41545)
0923 19:35:30.246065 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.246075 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.250511 (+ 4436us) server_negotiation.cc:407] Connection header received
0923 19:35:30.250701 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.250704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.250765 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.250843 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:30.251449 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.252240 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.254477 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.254934 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.255022 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.255597 (+ 575us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:30.255764 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:30.255832 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.256119 (+ 287us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.256212 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260923 19:35:30.256735 14608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.245756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41545 (local address 127.12.159.193:36547)
0923 19:35:30.250383 (+ 4627us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:30.250411 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:30.250577 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:30.250894 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:30.250899 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:30.250911 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:35:30.251293 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:30.251310 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.252370 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.252381 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:30.254331 (+ 1950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:30.254347 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.255119 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.255127 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:30.255322 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.255395 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:35:30.255861 (+ 466us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:35:30.255875 (+ 14us) client_negotiation.cc:769] Sending connection context
0923 19:35:30.255988 (+ 113us) client_negotiation.cc:240] Negotiation successful
0923 19:35:30.256171 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4401,"thread_start_us":4265,"threads_started":1}
I20260923 19:35:30.266139 14493 raft_consensus.cc:1261] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Refusing update from remote peer 4cf4e332e0424d32922a03c038ba37d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:30.266249 14349 raft_consensus.cc:1261] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Refusing update from remote peer 4cf4e332e0424d32922a03c038ba37d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:30.266695 14579 consensus_queue.cc:1035] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa06fc9f6584d0bb425fcfe5adff34f" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:30.266968 14565 consensus_queue.cc:1035] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3556b1a6e1b45ed8ea5679d4888d9ea" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:30.332235 14053 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:30.332499 14053 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:30.336349 14053 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3149cbd51ac34758831256c221481045: Sending DeleteTablet for 3 replicas of tablet 0248def9c64845a89ebfc4df2d569236
I20260923 19:35:30.337236 14189 tablet_service.cc:1514] Processing DeleteTablet for tablet 0248def9c64845a89ebfc4df2d569236 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:30 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:49442
I20260923 19:35:30.337489 14584 tablet_replica.cc:330] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: stopping tablet replica
I20260923 19:35:30.337671 14584 raft_consensus.cc:2229] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:30.337772 14329 tablet_service.cc:1514] Processing DeleteTablet for tablet 0248def9c64845a89ebfc4df2d569236 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:30 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:34570
I20260923 19:35:30.338115 14586 tablet_replica.cc:330] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: stopping tablet replica
I20260923 19:35:30.338236 14584 raft_consensus.cc:2258] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:30.338330 14586 raft_consensus.cc:2229] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:30.338514 14586 raft_consensus.cc:2258] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:30.339861 14586 ts_tablet_manager.cc:1905] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:30.339952 14584 ts_tablet_manager.cc:1905] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:30.340025 14468 tablet_service.cc:1514] Processing DeleteTablet for tablet 0248def9c64845a89ebfc4df2d569236 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:30 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:36356
I20260923 19:35:30.340291 14585 tablet_replica.cc:330] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: stopping tablet replica
I20260923 19:35:30.340449 14585 raft_consensus.cc:2229] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:30.340628 14585 raft_consensus.cc:2258] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:30.346887 14585 ts_tablet_manager.cc:1905] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:30.347540 14586 ts_tablet_manager.cc:1918] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:30.347682 14586 log.cc:1196] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/0248def9c64845a89ebfc4df2d569236
I20260923 19:35:30.348205 14586 ts_tablet_manager.cc:1939] T 0248def9c64845a89ebfc4df2d569236 P b3556b1a6e1b45ed8ea5679d4888d9ea: Deleting consensus metadata
I20260923 19:35:30.349366 14038 catalog_manager.cc:4841] TS b3556b1a6e1b45ed8ea5679d4888d9ea (127.12.159.194:35873): tablet 0248def9c64845a89ebfc4df2d569236 (table test-table [id=4aa780ed0038461b8b7227f9fa218753]) successfully deleted
I20260923 19:35:30.356612 14585 ts_tablet_manager.cc:1918] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:30.356948 14585 log.cc:1196] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/0248def9c64845a89ebfc4df2d569236
I20260923 19:35:30.357540 14585 ts_tablet_manager.cc:1939] T 0248def9c64845a89ebfc4df2d569236 P 9aa06fc9f6584d0bb425fcfe5adff34f: Deleting consensus metadata
I20260923 19:35:30.359105 14038 catalog_manager.cc:4841] TS 9aa06fc9f6584d0bb425fcfe5adff34f (127.12.159.195:41757): tablet 0248def9c64845a89ebfc4df2d569236 (table test-table [id=4aa780ed0038461b8b7227f9fa218753]) successfully deleted
I20260923 19:35:30.361850 14584 ts_tablet_manager.cc:1918] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:30.362054 14584 log.cc:1196] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/0248def9c64845a89ebfc4df2d569236
I20260923 19:35:30.362552 14584 ts_tablet_manager.cc:1939] T 0248def9c64845a89ebfc4df2d569236 P 4cf4e332e0424d32922a03c038ba37d9: Deleting consensus metadata
I20260923 19:35:30.363838 14040 catalog_manager.cc:4841] TS 4cf4e332e0424d32922a03c038ba37d9 (127.12.159.193:41545): tablet 0248def9c64845a89ebfc4df2d569236 (table test-table [id=4aa780ed0038461b8b7227f9fa218753]) successfully deleted
Sep 23 19:35:30 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192129, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:30.387626 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.350140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49480 (local address 127.12.159.193:41545)
0923 19:35:30.350342 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.350350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.366571 (+ 16221us) server_negotiation.cc:407] Connection header received
0923 19:35:30.366797 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.366802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.366871 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.366971 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:30.368446 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.369202 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.371851 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.372605 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.372706 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.378774 (+ 6068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:30.378791 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:30.378817 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:30.378868 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:30.383531 (+ 4663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.384546 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.384562 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.384602 (+ 40us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.384753 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.385231 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.385237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.385240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.385758 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:30.386143 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.386848 (+ 705us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.387107 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260923 19:35:30.389525 14255 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49480
I20260923 19:35:30.413213 14596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.392713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38504 (local address 127.12.159.254:33665)
0923 19:35:30.392946 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.392953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.398417 (+ 5464us) server_negotiation.cc:407] Connection header received
0923 19:35:30.398612 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.398618 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.398718 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.398820 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:30.400632 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.401796 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.403735 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.404403 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.404542 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.407634 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:30.407657 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:30.407661 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:30.407698 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:30.410476 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.411282 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.411294 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.411297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.411417 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.411849 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.411852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.411854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.412119 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:30.412385 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.412782 (+ 397us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.412950 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
W20260923 19:35:30.414069 14053 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38504
I20260923 19:35:30.416467 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14124
I20260923 19:35:30.431957 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.417662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49494 (local address 127.12.159.193:41545)
0923 19:35:30.417907 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.417913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.418113 (+ 200us) server_negotiation.cc:407] Connection header received
0923 19:35:30.418243 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.418249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.418349 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.418470 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:30.419540 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.420741 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.421950 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.422656 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.422814 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.425209 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:30.425216 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:30.425221 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:30.425261 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:30.428930 (+ 3669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.429622 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.429629 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.429632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.429846 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.430319 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.430324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.430327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.430693 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:30.430973 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.431257 (+ 284us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.431508 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260923 19:35:30.432646 14255 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49494
W20260923 19:35:30.433291 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14124: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:30.433502 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 14124
I20260923 19:35:30.456226 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14264
Sep 23 19:35:30 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192129, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:35:30.472942 14617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.457119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34586 (local address 127.12.159.194:35873)
0923 19:35:30.457559 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.457564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.457580 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:35:30.457633 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.457636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.457706 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.457797 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:30.459034 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.460061 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.461307 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.461755 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.462033 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.466385 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:30.466401 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:30.466416 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:30.466451 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:30.469674 (+ 3223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.470525 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.470532 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.470534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.470663 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.471149 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.471160 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.471162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.471539 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:30.471773 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.472389 (+ 616us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.472643 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":239,"threads_started":1}
W20260923 19:35:30.473754 14394 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34586
W20260923 19:35:30.474467 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14264: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:30.474625 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 14264
I20260923 19:35:30.492170 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14403
Sep 23 19:35:30 dist-test-slave-lzv7 krb5kdc[14008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192129, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:35:30.507680 14618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:30.492922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36362 (local address 127.12.159.195:41757)
0923 19:35:30.493599 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:30.493604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:30.493621 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:35:30.493687 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:30.493691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:30.493751 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:30.493917 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:30.495199 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.495951 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.497220 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:30.497651 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:30.497750 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:30.502162 (+ 4412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:30.502178 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:30.502195 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:30.502233 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:30.505194 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.505926 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.505934 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.505936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.506134 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:30.506448 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:30.506451 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:30.506453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:30.506792 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:30.506994 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:30.507245 (+ 251us) server_negotiation.cc:299] Negotiation successful
0923 19:35:30.507408 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":429,"threads_started":1}
W20260923 19:35:30.508368 14533 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36362
W20260923 19:35:30.509024 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14403: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:30.509194 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 14403
I20260923 19:35:30.528743 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14021
I20260923 19:35:30.530009 14093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:30.648952 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 14021
2026-09-23T19:35:30Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4635 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:30 dist-test-slave-lzv7 krb5kdc[14622](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:30 dist-test-slave-lzv7 krb5kdc[14622](info): set up 2 sockets
Sep 23 19:35:30 dist-test-slave-lzv7 krb5kdc[14622](info): commencing operation
krb5kdc: starting...
W20260923 19:35:31.738044 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:31 dist-test-slave-lzv7 krb5kdc[14622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:31.925238 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:44669
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:44669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:32.247648 14635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:32.247936 14635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:32.248077 14635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:32.255419 14635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:32.255528 14635 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 19:35:32.255594 14635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:32.255712 14635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:32.255812 14635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:32.255903 14635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:32.266080 14635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:44669
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:44669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:32.267478 14635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:32.268824 14635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:32.281028 14643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:32.281047 14640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:32.281137 14641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:32.282217 14635 server_base.cc:1034] running on GCE node
I20260923 19:35:32.282995 14635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:32.284567 14635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:32.285871 14635 hybrid_clock.cc:648] HybridClock initialized: now 1790192132285756 us; error 39 us; skew 500 ppm
I20260923 19:35:32.286247 14635 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:32 dist-test-slave-lzv7 krb5kdc[14622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192132, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:32.289368 14635 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:32.290900 14635 webserver.cc:460] Webserver started at http://127.12.159.254:40327/ using document root <none> and password file <none>
I20260923 19:35:32.291615 14635 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:32.291746 14635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:32.292110 14635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:32.295149 14635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "6c2ce116c1fa4967a6fb967d193e9464"
format_stamp: "Formatted at 2026-09-23 19:35:32 on dist-test-slave-lzv7"
server_key: "6c37b0b444b86062520078b68488192c"
server_key_iv: "336162d40b3ca765d8e4f221fa62b9fe"
server_key_version: "encryptionkey@0"
I20260923 19:35:32.295940 14635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "6c2ce116c1fa4967a6fb967d193e9464"
format_stamp: "Formatted at 2026-09-23 19:35:32 on dist-test-slave-lzv7"
server_key: "6c37b0b444b86062520078b68488192c"
server_key_iv: "336162d40b3ca765d8e4f221fa62b9fe"
server_key_version: "encryptionkey@0"
I20260923 19:35:32.301672 14635 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:35:32.305259 14650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:32.306720 14635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:35:32.306903 14635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "6c2ce116c1fa4967a6fb967d193e9464"
format_stamp: "Formatted at 2026-09-23 19:35:32 on dist-test-slave-lzv7"
server_key: "6c37b0b444b86062520078b68488192c"
server_key_iv: "336162d40b3ca765d8e4f221fa62b9fe"
server_key_version: "encryptionkey@0"
I20260923 19:35:32.307132 14635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:32.322495 14635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:32.326333 14635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:32.326608 14635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:32.348783 14635 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:44669
I20260923 19:35:32.348789 14711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:44669 every 8 connection(s)
I20260923 19:35:32.350304 14635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:32.353794 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 14635
I20260923 19:35:32.354027 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:32.354552 14712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:32.354806 12927 external_mini_cluster.cc:1428] Setting key 461d9a9e6e924a48782a529caea23306
Sep 23 19:35:32 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:32.368891 14712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Bootstrap starting.
I20260923 19:35:32.372776 14712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:32.374086 14712 log.cc:824] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:32.377620 14712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: No bootstrap required, opened a new log
I20260923 19:35:32.377655 14715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:32.356966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36310 (local address 127.12.159.254:44669)
0923 19:35:32.357784 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:32.357796 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:32.357897 (+ 101us) server_negotiation.cc:407] Connection header received
0923 19:35:32.359568 (+ 1671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:32.359592 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:32.360011 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:32.360429 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:32.361982 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.363269 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.364549 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.365280 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.365523 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:32.369851 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:32.369865 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:32.369891 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:32.369936 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:32.373033 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:32.373846 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:32.373861 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:32.373867 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:32.374035 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:32.374470 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:32.374475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:32.374478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:32.375352 (+ 874us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:32.375631 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:32.376206 (+ 575us) server_negotiation.cc:299] Negotiation successful
0923 19:35:32.376574 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":362,"threads_started":1}
I20260923 19:35:32.386729 14712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2ce116c1fa4967a6fb967d193e9464" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 44669 } }
I20260923 19:35:32.387163 14712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:32.387281 14712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c2ce116c1fa4967a6fb967d193e9464, State: Initialized, Role: FOLLOWER
I20260923 19:35:32.387961 14712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2ce116c1fa4967a6fb967d193e9464" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 44669 } }
I20260923 19:35:32.388238 14712 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:32.388393 14712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:32.388590 14712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:32.391309 14712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2ce116c1fa4967a6fb967d193e9464" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 44669 } }
I20260923 19:35:32.391844 14712 leader_election.cc:302] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c2ce116c1fa4967a6fb967d193e9464; no voters:
I20260923 19:35:32.392417 14712 leader_election.cc:288] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:32.392621 14717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:32.393524 14717 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [term 1 LEADER]: Becoming Leader. State: Replica: 6c2ce116c1fa4967a6fb967d193e9464, State: Running, Role: LEADER
I20260923 19:35:32.394124 14717 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2ce116c1fa4967a6fb967d193e9464" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 44669 } }
I20260923 19:35:32.394832 14712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:32.397199 14719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c2ce116c1fa4967a6fb967d193e9464. Latest consensus state: current_term: 1 leader_uuid: "6c2ce116c1fa4967a6fb967d193e9464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2ce116c1fa4967a6fb967d193e9464" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 44669 } } }
I20260923 19:35:32.397537 14719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:32.398566 14718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c2ce116c1fa4967a6fb967d193e9464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2ce116c1fa4967a6fb967d193e9464" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 44669 } } }
I20260923 19:35:32.398941 14718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:32.400386 14723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:32.406840 14723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:32.416078 14723 catalog_manager.cc:1347] Generated new cluster ID: e120c415d2c34fc78aaf6e8e52ee02c3
I20260923 19:35:32.416224 14723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:32.443876 14723 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:32.445915 14723 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:32.457697 14723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Generated new TSK 0
I20260923 19:35:32.458796 14723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:32.523406 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:44669
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:32.867707 14738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:32.868009 14738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:32.868165 14738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:32.875418 14738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:32.875527 14738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:32.875707 14738 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 19:35:32.875769 14738 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:35:32.875914 14738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:32.885599 14738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:44669
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:32.887127 14738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:32.888477 14738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:32.901934 14743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:32.901885 14746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:32.901909 14744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:32.908077 14738 server_base.cc:1034] running on GCE node
I20260923 19:35:32.908762 14738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:32.909842 14738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:32.911103 14738 hybrid_clock.cc:648] HybridClock initialized: now 1790192132911037 us; error 45 us; skew 500 ppm
I20260923 19:35:32.911442 14738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:32 dist-test-slave-lzv7 krb5kdc[14622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192132, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:32.914871 14738 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:32.916450 14738 webserver.cc:460] Webserver started at http://127.12.159.193:34279/ using document root <none> and password file <none>
I20260923 19:35:32.917181 14738 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:32.917330 14738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:32.917656 14738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:32.920702 14738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "51d7d7a8d5504095b93600d1498b79e6"
format_stamp: "Formatted at 2026-09-23 19:35:32 on dist-test-slave-lzv7"
server_key: "79a4ecb44f9bdd0531bbc2a2223e1c28"
server_key_iv: "132abcde48ac33bf587839d479ac6166"
server_key_version: "encryptionkey@0"
I20260923 19:35:32.921526 14738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "51d7d7a8d5504095b93600d1498b79e6"
format_stamp: "Formatted at 2026-09-23 19:35:32 on dist-test-slave-lzv7"
server_key: "79a4ecb44f9bdd0531bbc2a2223e1c28"
server_key_iv: "132abcde48ac33bf587839d479ac6166"
server_key_version: "encryptionkey@0"
I20260923 19:35:32.927268 14738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:35:32.931048 14753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:32.932438 14738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:35:32.932632 14738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "51d7d7a8d5504095b93600d1498b79e6"
format_stamp: "Formatted at 2026-09-23 19:35:32 on dist-test-slave-lzv7"
server_key: "79a4ecb44f9bdd0531bbc2a2223e1c28"
server_key_iv: "132abcde48ac33bf587839d479ac6166"
server_key_version: "encryptionkey@0"
I20260923 19:35:32.932852 14738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:32.944680 14738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:32.948987 14738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:32.949288 14738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:32.951995 14738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:32.952139 14738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:32.952257 14738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:32.952329 14738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:35:32 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192132, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:32.978026 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:32.952898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:33287 (local address 127.12.159.254:44669)
0923 19:35:32.953430 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:32.953434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:32.954625 (+ 1191us) server_negotiation.cc:407] Connection header received
0923 19:35:32.956777 (+ 2152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:32.956783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:32.956876 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:32.957005 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:32.959710 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.960995 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.963602 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.964302 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.964449 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:32.969872 (+ 5423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:32.969883 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:32.969891 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:32.969956 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:32.973707 (+ 3751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:32.975112 (+ 1405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:32.975120 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:32.975129 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:32.975312 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:32.976014 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:32.976021 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:32.976026 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:32.976383 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:32.976548 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:32.977384 (+ 836us) server_negotiation.cc:299] Negotiation successful
0923 19:35:32.977638 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":312,"threads_started":1}
I20260923 19:35:32.979264 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:32.953530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:44669 (local address 127.12.159.193:33287)
0923 19:35:32.954461 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:32.954500 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:32.956497 (+ 1997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:32.957602 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:32.957616 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:32.958516 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:32.959470 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:32.959502 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.961217 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.961222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:32.963445 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:32.963458 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.964625 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.964638 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:32.965047 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:32.966057 (+ 1010us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:32.966100 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:32.969513 (+ 3413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:32.973929 (+ 4416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:32.973944 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:32.973964 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:32.974970 (+ 1006us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:32.975459 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:32.975470 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:32.975475 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:32.975837 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:32.976527 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:32.976535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:32.976969 (+ 434us) client_negotiation.cc:769] Sending connection context
0923 19:35:32.977265 (+ 296us) client_negotiation.cc:240] Negotiation successful
0923 19:35:32.977896 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":415,"threads_started":1}
I20260923 19:35:33.002409 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:32.987548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:44669 (local address 127.12.159.193:38669)
0923 19:35:32.988211 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:32.988232 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:32.988375 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:32.988767 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:32.988770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:32.989197 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:32.989483 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:32.989492 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.991036 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.991040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:32.992336 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:32.992357 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.993397 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.993404 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:32.993565 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:32.994292 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:32.994321 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:32.995472 (+ 1151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:32.998856 (+ 3384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:32.998865 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:32.998872 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:32.999811 (+ 939us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:33.000338 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:33.000343 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:33.000351 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:33.000599 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:33.001413 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:33.001416 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:33.001576 (+ 160us) client_negotiation.cc:769] Sending connection context
0923 19:35:33.001709 (+ 133us) client_negotiation.cc:240] Negotiation successful
0923 19:35:33.002040 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":379,"threads_started":1}
I20260923 19:35:33.002750 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:32.987416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:38669 (local address 127.12.159.254:44669)
0923 19:35:32.987644 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:32.987651 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:32.988355 (+ 704us) server_negotiation.cc:407] Connection header received
0923 19:35:32.988486 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:32.988495 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:32.988609 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:32.988752 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:32.989635 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.990895 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.992565 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:32.993181 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:32.993317 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:32.995720 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:32.995725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:32.995728 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:32.995761 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:32.998686 (+ 2925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:32.999985 (+ 1299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:32.999993 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:32.999997 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:33.000196 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:33.000764 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:33.000773 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:33.000779 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:33.001276 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:33.001473 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:33.001875 (+ 402us) server_negotiation.cc:299] Negotiation successful
0923 19:35:33.002242 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:35:33.009346 14738 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:43745
I20260923 19:35:33.009383 14873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:43745 every 8 connection(s)
I20260923 19:35:33.010787 14738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:33.013209 14874 heartbeater.cc:347] Connected to a master server at 127.12.159.254:44669
I20260923 19:35:33.013473 14874 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:33.014266 14874 heartbeater.cc:511] Master 127.12.159.254:44669 requested a full tablet report, sending...
I20260923 19:35:33.015537 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 14738
I20260923 19:35:33.015733 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:33.016367 12927 external_mini_cluster.cc:1428] Setting key 538ec69e65b1f72f1b91e88808143602
I20260923 19:35:33.016428 14667 ts_manager.cc:194] Registered new tserver with Master: 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745)
I20260923 19:35:33.018143 14667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:33287
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:33.062119 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:44669
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:33.388845 14878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:33.389139 14878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:33.389300 14878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:33.396694 14878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:33.396806 14878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:33.396981 14878 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 19:35:33.397061 14878 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:35:33.397200 14878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:33.407395 14878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:44669
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:33.408726 14878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:33.410082 14878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:33.426252 14883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:33.426185 14884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:33.426241 14886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:33.427394 14878 server_base.cc:1034] running on GCE node
I20260923 19:35:33.428125 14878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:33.429162 14878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:33.430440 14878 hybrid_clock.cc:648] HybridClock initialized: now 1790192133430395 us; error 83 us; skew 500 ppm
I20260923 19:35:33.430902 14878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:33 dist-test-slave-lzv7 krb5kdc[14622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192133, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:33.434275 14878 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:33.435879 14878 webserver.cc:460] Webserver started at http://127.12.159.194:41051/ using document root <none> and password file <none>
I20260923 19:35:33.436650 14878 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:33.436839 14878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:33.437184 14878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:33.440299 14878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "ac8be185551c44c6846a2f00bc4515c2"
format_stamp: "Formatted at 2026-09-23 19:35:33 on dist-test-slave-lzv7"
server_key: "c9257a620420b6f740f87c67f06ba567"
server_key_iv: "9be448c09da9aab39318750959b00343"
server_key_version: "encryptionkey@0"
I20260923 19:35:33.441064 14878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "ac8be185551c44c6846a2f00bc4515c2"
format_stamp: "Formatted at 2026-09-23 19:35:33 on dist-test-slave-lzv7"
server_key: "c9257a620420b6f740f87c67f06ba567"
server_key_iv: "9be448c09da9aab39318750959b00343"
server_key_version: "encryptionkey@0"
I20260923 19:35:33.447136 14878 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260923 19:35:33.450947 14893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:33.452636 14878 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:35:33.452863 14878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "ac8be185551c44c6846a2f00bc4515c2"
format_stamp: "Formatted at 2026-09-23 19:35:33 on dist-test-slave-lzv7"
server_key: "c9257a620420b6f740f87c67f06ba567"
server_key_iv: "9be448c09da9aab39318750959b00343"
server_key_version: "encryptionkey@0"
I20260923 19:35:33.453105 14878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:33.488039 14878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:33.492861 14878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:33.493216 14878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:33.496335 14878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:33.496493 14878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:33.496630 14878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:33.496740 14878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:35:33 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192133, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:33.523854 14902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:33.498079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:44669 (local address 127.12.159.194:48237)
0923 19:35:33.498992 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:33.499051 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:33.501663 (+ 2612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:33.502678 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:33.502692 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:33.503793 (+ 1101us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:33.504989 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:33.505031 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.506439 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.506445 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:33.508139 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:33.508152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.509151 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.509162 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:33.509401 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:33.510229 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:33.510296 (+ 67us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:33.513724 (+ 3428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:33.517924 (+ 4200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:33.517939 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:33.517966 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:33.518899 (+ 933us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:33.519358 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:33.519363 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:33.519370 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:33.519755 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:33.520610 (+ 855us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:33.520616 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:33.521162 (+ 546us) client_negotiation.cc:769] Sending connection context
0923 19:35:33.521476 (+ 314us) client_negotiation.cc:240] Negotiation successful
0923 19:35:33.522172 (+ 696us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":413,"threads_started":1}
I20260923 19:35:33.524492 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:33.497223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:48237 (local address 127.12.159.254:44669)
0923 19:35:33.497401 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:33.497408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:33.499213 (+ 1805us) server_negotiation.cc:407] Connection header received
0923 19:35:33.502047 (+ 2834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:33.502052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:33.502164 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:33.502307 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:33.505237 (+ 2930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.506282 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.508296 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.508894 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.509027 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:33.514075 (+ 5048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:33.514086 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:33.514089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:33.514128 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:33.517728 (+ 3600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:33.519059 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:33.519072 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:33.519077 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:33.519228 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:33.519883 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:33.519888 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:33.519892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:33.520387 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:33.520538 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:33.523954 (+ 3416us) server_negotiation.cc:299] Negotiation successful
0923 19:35:33.524196 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:35:33.545347 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:33.530818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:57193 (local address 127.12.159.254:44669)
0923 19:35:33.530985 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:33.530989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:33.531667 (+ 678us) server_negotiation.cc:407] Connection header received
0923 19:35:33.531877 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:33.531889 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:33.531951 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:33.532059 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:33.533612 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.534645 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.536782 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.537192 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.537327 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:33.539203 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:33.539209 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:33.539212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:33.539243 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:33.542404 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:33.543110 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:33.543116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:33.543120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:33.543257 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:33.543611 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:33.543617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:33.543620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:33.543948 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:33.544122 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:33.544621 (+ 499us) server_negotiation.cc:299] Negotiation successful
0923 19:35:33.544871 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 19:35:33.545991 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:33.530864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:44669 (local address 127.12.159.194:57193)
0923 19:35:33.531557 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:33.531573 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:33.531739 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:33.532096 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:33.532100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:33.532880 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:33.533395 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:33.533417 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.534819 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.534822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:33.536547 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:33.536559 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:33.537409 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:33.537415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:33.537566 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:33.538247 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:33.538264 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:33.538978 (+ 714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:33.542539 (+ 3561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:33.542544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:33.542548 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:33.542977 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:33.543367 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:33.543373 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:33.543377 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:33.543502 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:33.544083 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:33.544087 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:33.544278 (+ 191us) client_negotiation.cc:769] Sending connection context
0923 19:35:33.544476 (+ 198us) client_negotiation.cc:240] Negotiation successful
0923 19:35:33.544881 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":413,"threads_started":1}
I20260923 19:35:33.555500 14878 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:37417
I20260923 19:35:33.555517 15012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:37417 every 8 connection(s)
I20260923 19:35:33.556927 14878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:33.559442 15013 heartbeater.cc:347] Connected to a master server at 127.12.159.254:44669
I20260923 19:35:33.559650 15013 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:33.560318 15013 heartbeater.cc:511] Master 127.12.159.254:44669 requested a full tablet report, sending...
I20260923 19:35:33.561811 14667 ts_manager.cc:194] Registered new tserver with Master: ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417)
I20260923 19:35:33.562155 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 14878
I20260923 19:35:33.562328 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:33.562878 12927 external_mini_cluster.cc:1428] Setting key e30f50482e0a9cdd6ad2564dda418f4d
I20260923 19:35:33.563153 14667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:48237
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:33.606680 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:44669
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:33.937862 15017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:33.938141 15017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:33.938331 15017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:33.945554 15017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:33.945667 15017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:33.945883 15017 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 19:35:33.945973 15017 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:35:33.946107 15017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:33.956347 15017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:44669
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:33.957710 15017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:33.959527 15017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:33.972927 15023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:33.973014 15022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:33.972991 15025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:33.974255 15017 server_base.cc:1034] running on GCE node
I20260923 19:35:33.974901 15017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:33.975893 15017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:33.977216 15017 hybrid_clock.cc:648] HybridClock initialized: now 1790192133977158 us; error 62 us; skew 500 ppm
I20260923 19:35:33.977559 15017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:33 dist-test-slave-lzv7 krb5kdc[14622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192133, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:33.980741 15017 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:33.982427 15017 webserver.cc:460] Webserver started at http://127.12.159.195:46503/ using document root <none> and password file <none>
I20260923 19:35:33.983125 15017 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:33.983225 15017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:33.983533 15017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:33.986553 15017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "94f0e62606024529974022d15a2c29e1"
format_stamp: "Formatted at 2026-09-23 19:35:33 on dist-test-slave-lzv7"
server_key: "7f1ee9b59b64820523d7ace6df1d7349"
server_key_iv: "62824a8e49110ea344ff31df5ff7f2dc"
server_key_version: "encryptionkey@0"
I20260923 19:35:33.987273 15017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "94f0e62606024529974022d15a2c29e1"
format_stamp: "Formatted at 2026-09-23 19:35:33 on dist-test-slave-lzv7"
server_key: "7f1ee9b59b64820523d7ace6df1d7349"
server_key_iv: "62824a8e49110ea344ff31df5ff7f2dc"
server_key_version: "encryptionkey@0"
I20260923 19:35:33.992476 15017 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:33.996184 15032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:33.997699 15017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:33.997920 15017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "94f0e62606024529974022d15a2c29e1"
format_stamp: "Formatted at 2026-09-23 19:35:33 on dist-test-slave-lzv7"
server_key: "7f1ee9b59b64820523d7ace6df1d7349"
server_key_iv: "62824a8e49110ea344ff31df5ff7f2dc"
server_key_version: "encryptionkey@0"
I20260923 19:35:33.998147 15017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:34.012738 15017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:34.017153 15017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:34.017442 15017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:34.020079 15017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:34.020226 15017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:34.020349 15017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:34.020442 15017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:34.022058 14874 heartbeater.cc:503] Master 127.12.159.254:44669 was elected leader, sending a full tablet report...
Sep 23 19:35:34 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192133, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:34.045208 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.020787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:57593 (local address 127.12.159.254:44669)
0923 19:35:34.020976 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.020982 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.022589 (+ 1607us) server_negotiation.cc:407] Connection header received
0923 19:35:34.025953 (+ 3364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.025960 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.026059 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.026160 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:34.028708 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.029421 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.032624 (+ 3203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.033119 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.033266 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.038239 (+ 4973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:34.038246 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:34.038251 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:34.038296 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:34.041632 (+ 3336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.042761 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.042766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.042770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.042905 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.043347 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.043352 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.043356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.043641 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:34.043803 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.044577 (+ 774us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.044841 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:35:34.047032 15041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.021348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:44669 (local address 127.12.159.195:57593)
0923 19:35:34.022371 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.022433 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.025533 (+ 3100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.026467 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.026482 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.027483 (+ 1001us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:34.028502 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.028533 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.029599 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.029607 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.032441 (+ 2834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.032461 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.033403 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.033413 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.033764 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.034689 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:34.034712 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:34.037936 (+ 3224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:34.041782 (+ 3846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:34.041795 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:34.041842 (+ 47us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:34.042621 (+ 779us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:34.043016 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:34.043022 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:34.043025 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:34.043224 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:34.043776 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:34.043785 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:34.044173 (+ 388us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.044438 (+ 265us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.045033 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":440,"threads_started":1}
I20260923 19:35:34.068399 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.052734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:40119 (local address 127.12.159.254:44669)
0923 19:35:34.052977 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.052985 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.053533 (+ 548us) server_negotiation.cc:407] Connection header received
0923 19:35:34.053758 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.053762 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.053882 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.053994 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:34.055428 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.056408 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.058031 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.058878 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.059051 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.061075 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:34.061085 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:34.061093 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:34.061147 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:34.065088 (+ 3941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.066330 (+ 1242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.066336 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.066339 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.066492 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.066982 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.066985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.066987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.067262 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:34.067381 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.067946 (+ 565us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.068126 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:35:34.069042 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.052657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:44669 (local address 127.12.159.195:40119)
0923 19:35:34.053412 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.053437 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.053633 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.054024 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.054029 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.054758 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:34.055284 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.055300 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.056549 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.056555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.057796 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.057861 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.059115 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.059123 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.059359 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.060085 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:34.060102 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:34.060840 (+ 738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:34.065299 (+ 4459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:34.065308 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:34.065313 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:34.066165 (+ 852us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:34.066630 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:34.066638 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:34.066645 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:34.066855 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:34.067385 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:34.067393 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:34.067674 (+ 281us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.067862 (+ 188us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.068373 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":364,"threads_started":1}
I20260923 19:35:34.083734 15017 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:37675
I20260923 19:35:34.083853 15151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:37675 every 8 connection(s)
I20260923 19:35:34.085013 15017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:34.086055 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 15017
I20260923 19:35:34.086252 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:34.086735 12927 external_mini_cluster.cc:1428] Setting key 5534c39fb14ea82f09fd86ccf5375963
I20260923 19:35:34.087560 15152 heartbeater.cc:347] Connected to a master server at 127.12.159.254:44669
I20260923 19:35:34.087805 15152 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:34.088457 15152 heartbeater.cc:511] Master 127.12.159.254:44669 requested a full tablet report, sending...
I20260923 19:35:34.089859 14667 ts_manager.cc:194] Registered new tserver with Master: 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:34.090736 14667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:57593
I20260923 19:35:34.102726 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:35:34 dist-test-slave-lzv7 krb5kdc[14622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:35:34 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:34.150727 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.136221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.12.159.254:44669)
0923 19:35:34.136475 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.136483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.136888 (+ 405us) server_negotiation.cc:407] Connection header received
0923 19:35:34.137100 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.137105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.137187 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.137318 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:34.138807 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.139552 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.140817 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.141252 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.141395 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.145425 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:34.145430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:34.145433 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:34.145469 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:34.148029 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.148701 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.148707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.148711 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.148841 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.149254 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.149260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.149263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.149551 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:34.149803 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.150150 (+ 347us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.150381 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:35:34.154835 14667 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:34.162075 14667 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:34.201263 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.175990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51512 (local address 127.12.159.193:43745)
0923 19:35:34.192874 (+ 16884us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.192884 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.192914 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:35:34.193018 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.193025 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.193316 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.193496 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:34.194592 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.195949 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.198521 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.200060 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.200244 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.200435 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.200738 (+ 303us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.200931 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16626,"thread_start_us":16500,"threads_started":1}
I20260923 19:35:34.201438 15169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.175747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43745 (local address 127.0.0.1:51512)
0923 19:35:34.190619 (+ 14872us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.190642 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.190775 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.193692 (+ 2917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.193698 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.193728 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:34.194340 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.194359 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.196129 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.196148 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.198354 (+ 2206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.198368 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.200262 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.200269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.200473 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.200524 (+ 51us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.200670 (+ 146us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.200890 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14728,"mutex_wait_us":129,"thread_start_us":12221,"threads_started":1}
I20260923 19:35:34.202491 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.189372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:37417 (local address 127.0.0.1:45270)
0923 19:35:34.192188 (+ 2816us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.192204 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.192304 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.193745 (+ 1441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.193751 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.193787 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:34.194389 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.194401 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.196156 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.196161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.198859 (+ 2698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.198869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.201174 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.201183 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.201875 (+ 692us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.201903 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.201992 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.202134 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2690,"mutex_wait_us":281,"thread_start_us":931,"threads_started":1}
I20260923 19:35:34.202627 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.189437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45270 (local address 127.12.159.194:37417)
0923 19:35:34.193163 (+ 3726us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.193175 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.193204 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:35:34.193304 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.193311 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.193549 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.193753 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:34.194566 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.196007 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.199032 (+ 3025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.200476 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.200688 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.200873 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.202151 (+ 1278us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.202337 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3555,"thread_start_us":3432,"threads_started":1}
I20260923 19:35:34.203541 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.175649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.12.159.195:37675)
0923 19:35:34.191092 (+ 15443us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.191106 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.191149 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:35:34.191278 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.191291 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.191663 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.193332 (+ 1669us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:34.194213 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.195951 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.199033 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.200559 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.200775 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.200909 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.202988 (+ 2079us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.203174 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15211,"thread_start_us":15037,"threads_started":1}
I20260923 19:35:34.203466 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.175368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:37675 (local address 127.0.0.1:51530)
0923 19:35:34.187364 (+ 11996us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.187429 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.187714 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.193333 (+ 5619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.193341 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.193373 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:34.193977 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.193999 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.196156 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.196161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.198817 (+ 2656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.198834 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.201182 (+ 2348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.201189 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.201676 (+ 487us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.201751 (+ 75us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.202930 (+ 1179us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.203067 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11587,"mutex_wait_us":339,"thread_start_us":16564,"threads_started":1}
I20260923 19:35:34.205747 14804 tablet_service.cc:1467] Processing CreateTablet for tablet ce4b18fa48b248f6ae323d5b31ca28fa (DEFAULT_TABLE table=test-table [id=707d15a41306483d84b7566df41f24c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:34.207291 14804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce4b18fa48b248f6ae323d5b31ca28fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.207330 14943 tablet_service.cc:1467] Processing CreateTablet for tablet ce4b18fa48b248f6ae323d5b31ca28fa (DEFAULT_TABLE table=test-table [id=707d15a41306483d84b7566df41f24c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:34.207553 15082 tablet_service.cc:1467] Processing CreateTablet for tablet ce4b18fa48b248f6ae323d5b31ca28fa (DEFAULT_TABLE table=test-table [id=707d15a41306483d84b7566df41f24c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:34.208662 14943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce4b18fa48b248f6ae323d5b31ca28fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.208873 15082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce4b18fa48b248f6ae323d5b31ca28fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.220638 15171 tablet_bootstrap.cc:492] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Bootstrap starting.
I20260923 19:35:34.222822 15173 tablet_bootstrap.cc:492] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Bootstrap starting.
I20260923 19:35:34.225564 15171 tablet_bootstrap.cc:654] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.226207 15173 tablet_bootstrap.cc:654] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.226917 15171 log.cc:824] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:34.227425 15173 log.cc:824] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:34.227718 15172 tablet_bootstrap.cc:492] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Bootstrap starting.
I20260923 19:35:34.230715 15171 tablet_bootstrap.cc:492] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: No bootstrap required, opened a new log
I20260923 19:35:34.230995 15171 ts_tablet_manager.cc:1397] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260923 19:35:34.231139 15173 tablet_bootstrap.cc:492] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: No bootstrap required, opened a new log
I20260923 19:35:34.231276 15172 tablet_bootstrap.cc:654] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.231411 15173 ts_tablet_manager.cc:1397] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:35:34.232498 15172 log.cc:824] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:34.238750 15172 tablet_bootstrap.cc:492] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: No bootstrap required, opened a new log
I20260923 19:35:34.239054 15172 ts_tablet_manager.cc:1397] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260923 19:35:34.239684 15173 raft_consensus.cc:348] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.240056 15173 raft_consensus.cc:374] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.240155 15173 raft_consensus.cc:729] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8be185551c44c6846a2f00bc4515c2, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.240768 15173 consensus_queue.cc:260] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.241840 15013 heartbeater.cc:503] Master 127.12.159.254:44669 was elected leader, sending a full tablet report...
I20260923 19:35:34.242524 15173 ts_tablet_manager.cc:1428] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260923 19:35:34.242686 15171 raft_consensus.cc:348] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.244002 15171 raft_consensus.cc:374] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.244163 15171 raft_consensus.cc:729] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f0e62606024529974022d15a2c29e1, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.244748 15171 consensus_queue.cc:260] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.248899 15172 raft_consensus.cc:348] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.249316 15172 raft_consensus.cc:374] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.249413 15172 raft_consensus.cc:729] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.250034 15172 consensus_queue.cc:260] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.251875 15172 ts_tablet_manager.cc:1428] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Time spent starting tablet: real 0.013s user 0.007s sys 0.006s
I20260923 19:35:34.252774 15152 heartbeater.cc:503] Master 127.12.159.254:44669 was elected leader, sending a full tablet report...
I20260923 19:35:34.253324 15171 ts_tablet_manager.cc:1428] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Time spent starting tablet: real 0.022s user 0.015s sys 0.006s
W20260923 19:35:34.264652 14875 tablet.cc:2369] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:35:34.286248 15177 raft_consensus.cc:482] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:34.286599 15177 raft_consensus.cc:504] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.288297 15177 leader_election.cc:288] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675), 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745)
I20260923 19:35:34.296438 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.289068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:37521 (local address 127.12.159.195:37675)
0923 19:35:34.289274 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.289282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.289886 (+ 604us) server_negotiation.cc:407] Connection header received
0923 19:35:34.290037 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.290042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.290125 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.290244 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:34.291109 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.292216 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.294572 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.295415 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.295594 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.295685 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.296030 (+ 345us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.296155 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:35:34.296602 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.288849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:52761 (local address 127.12.159.193:43745)
0923 19:35:34.289054 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.289061 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.289778 (+ 717us) server_negotiation.cc:407] Connection header received
0923 19:35:34.290036 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.290042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.290125 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.290236 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:34.291109 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.292234 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.294647 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.295587 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.295782 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.295861 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.296160 (+ 299us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.296326 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:35:34.296671 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.288725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:37675 (local address 127.12.159.194:37521)
0923 19:35:34.289773 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.289788 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.289913 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.290279 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.290284 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.290338 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:34.290896 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.290918 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.292368 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.292373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.294396 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.294416 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.295636 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.295642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.295813 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.295863 (+ 50us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.295990 (+ 127us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.296129 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":923,"mutex_wait_us":206,"spinlock_wait_cycles":30336,"thread_start_us":742,"threads_started":1}
I20260923 19:35:34.296933 15180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.288673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43745 (local address 127.12.159.194:52761)
0923 19:35:34.289644 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.289664 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.289865 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.290279 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.290284 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.290339 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:34.290980 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.290988 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.292445 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.292451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.294420 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.294473 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.295818 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.295824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.296000 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.296023 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.296130 (+ 107us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.296272 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"mutex_wait_us":48,"spinlock_wait_cycles":5760,"thread_start_us":555,"threads_started":1}
I20260923 19:35:34.297677 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce4b18fa48b248f6ae323d5b31ca28fa" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1" is_pre_election: true
I20260923 19:35:34.297853 14824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce4b18fa48b248f6ae323d5b31ca28fa" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d7d7a8d5504095b93600d1498b79e6" is_pre_election: true
I20260923 19:35:34.298290 15107 raft_consensus.cc:2454] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 0.
I20260923 19:35:34.298437 14824 raft_consensus.cc:2454] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 0.
I20260923 19:35:34.299031 14894 leader_election.cc:302] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, 94f0e62606024529974022d15a2c29e1, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:34.299530 15177 raft_consensus.cc:2781] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:34.299706 15177 raft_consensus.cc:482] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:34.299822 15177 raft_consensus.cc:3037] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:34.302107 15177 raft_consensus.cc:504] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
I20260923 19:35:34.302732 15177 leader_election.cc:288] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 election: Requested vote from peers 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675), 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745)
I20260923 19:35:34.303349 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce4b18fa48b248f6ae323d5b31ca28fa" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1"
I20260923 19:35:34.303347 14824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce4b18fa48b248f6ae323d5b31ca28fa" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d7d7a8d5504095b93600d1498b79e6"
I20260923 19:35:34.303573 14824 raft_consensus.cc:3037] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:34.303565 15107 raft_consensus.cc:3037] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:34.306885 14824 raft_consensus.cc:2454] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 1.
I20260923 19:35:34.306885 15107 raft_consensus.cc:2454] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 1.
I20260923 19:35:34.307348 14895 leader_election.cc:302] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:34.307770 15177 raft_consensus.cc:2781] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:34.308259 15177 raft_consensus.cc:686] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 1 LEADER]: Becoming Leader. State: Replica: ac8be185551c44c6846a2f00bc4515c2, State: Running, Role: LEADER
I20260923 19:35:34.308743 15177 consensus_queue.cc:237] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } }
W20260923 19:35:34.309096 15014 tablet.cc:2369] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:35:34.313784 14667 catalog_manager.cc:5495] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194). New cstate: current_term: 1 leader_uuid: "ac8be185551c44c6846a2f00bc4515c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } health_report { overall_health: HEALTHY } } }
W20260923 19:35:34.336666 15153 tablet.cc:2369] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 19:35:34 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192132, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:34.364975 15189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.348839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:44669 (local address 127.0.0.1:36328)
0923 19:35:34.349772 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.349792 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.349962 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.350322 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.350327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.351229 (+ 902us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:34.351602 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.351615 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.352751 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.352756 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.354435 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.354450 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.355266 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.355273 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.355463 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.356170 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:34.356193 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:34.359010 (+ 2817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:34.362321 (+ 3311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:34.362334 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:34.362343 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:34.362806 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:34.363182 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:34.363190 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:34.363193 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:34.363329 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:34.363865 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:34.363874 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:34.364043 (+ 169us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.364202 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.364507 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":530,"threads_started":1}
I20260923 19:35:34.365172 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.348783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36328 (local address 127.12.159.254:44669)
0923 19:35:34.349083 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.349109 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.349906 (+ 797us) server_negotiation.cc:407] Connection header received
0923 19:35:34.350097 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.350102 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.350171 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.350269 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:34.351766 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.352620 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.354611 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.355072 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.355176 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.359200 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:34.359205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:34.359207 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:34.359235 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:34.362182 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.362929 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.362944 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.362946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.363072 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:34.363438 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:34.363444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:34.363452 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:34.363742 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:34.363890 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.364294 (+ 404us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.364818 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":138,"server-negotiator.queue_time_us":144}
I20260923 19:35:34.370394 14666 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:36328:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 19:35:34.371484 14666 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:34.378639 14943 tablet_service.cc:1467] Processing CreateTablet for tablet 210830cb2fa74d9f99f9918712d53533 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7c47fa28379c44c98ef6869053e74baa]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:35:34.378501 14804 tablet_service.cc:1467] Processing CreateTablet for tablet 210830cb2fa74d9f99f9918712d53533 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7c47fa28379c44c98ef6869053e74baa]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:35:34.379009 15082 tablet_service.cc:1467] Processing CreateTablet for tablet 210830cb2fa74d9f99f9918712d53533 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7c47fa28379c44c98ef6869053e74baa]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:35:34.379530 14804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210830cb2fa74d9f99f9918712d53533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.379541 14943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210830cb2fa74d9f99f9918712d53533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.379787 15082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 210830cb2fa74d9f99f9918712d53533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.385847 15173 tablet_bootstrap.cc:492] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: Bootstrap starting.
I20260923 19:35:34.386790 15171 tablet_bootstrap.cc:492] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: Bootstrap starting.
I20260923 19:35:34.387491 15172 tablet_bootstrap.cc:492] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: Bootstrap starting.
I20260923 19:35:34.387686 15173 tablet_bootstrap.cc:654] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.388389 15171 tablet_bootstrap.cc:654] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.389106 15172 tablet_bootstrap.cc:654] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.390883 15171 tablet_bootstrap.cc:492] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: No bootstrap required, opened a new log
I20260923 19:35:34.390965 15173 tablet_bootstrap.cc:492] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: No bootstrap required, opened a new log
I20260923 19:35:34.391052 15171 ts_tablet_manager.cc:1397] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260923 19:35:34.391111 15173 ts_tablet_manager.cc:1397] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260923 19:35:34.391891 15171 raft_consensus.cc:348] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.391891 15173 raft_consensus.cc:348] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.392177 15171 raft_consensus.cc:374] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.392177 15173 raft_consensus.cc:374] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.392284 15171 raft_consensus.cc:729] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f0e62606024529974022d15a2c29e1, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.392284 15173 raft_consensus.cc:729] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8be185551c44c6846a2f00bc4515c2, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.392536 15171 consensus_queue.cc:260] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.392553 15173 consensus_queue.cc:260] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.393162 15171 ts_tablet_manager.cc:1428] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260923 19:35:34.393231 15177 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.393523 15177 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:34.393548 15172 tablet_bootstrap.cc:492] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: No bootstrap required, opened a new log
I20260923 19:35:34.393759 15172 ts_tablet_manager.cc:1397] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 19:35:34.393827 15173 ts_tablet_manager.cc:1428] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:34.393882 15178 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.394243 15178 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:34.394832 15172 raft_consensus.cc:348] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.395038 15172 raft_consensus.cc:374] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.395152 15172 raft_consensus.cc:729] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.395418 15172 consensus_queue.cc:260] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.396020 15172 ts_tablet_manager.cc:1428] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:35:34.396178 15179 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.396562 15179 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:34.521097 15179 raft_consensus.cc:482] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:34.521373 15179 raft_consensus.cc:504] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.523368 15179 leader_election.cc:288] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:34.531888 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.524042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:60331 (local address 127.12.159.194:37417)
0923 19:35:34.524496 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.524504 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.524557 (+ 53us) server_negotiation.cc:407] Connection header received
0923 19:35:34.524687 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.524721 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.524852 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.525072 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:34.525965 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.527170 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.529679 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.530912 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.531104 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.531193 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.531460 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.531597 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260923 19:35:34.531991 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.523574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:37417 (local address 127.12.159.193:60331)
0923 19:35:34.524204 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.524227 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.524373 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.525081 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.525089 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.525128 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:34.525690 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.525707 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.527304 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.527309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.529533 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.529546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.531122 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.531128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.531305 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.531329 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.531436 (+ 107us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.531580 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":314,"threads_started":1}
I20260923 19:35:34.532711 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.524579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:53937 (local address 127.12.159.195:37675)
0923 19:35:34.524775 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.524781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.525956 (+ 1175us) server_negotiation.cc:407] Connection header received
0923 19:35:34.526316 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.526322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.526405 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.526501 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:34.527420 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.528555 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.530819 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.531564 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.531766 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.531852 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.532317 (+ 465us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.532435 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:35:34.533015 14963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210830cb2fa74d9f99f9918712d53533" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8be185551c44c6846a2f00bc4515c2" is_pre_election: true
I20260923 19:35:34.533411 15194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.524836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:37675 (local address 127.12.159.193:53937)
0923 19:35:34.525853 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.525876 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.526127 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.526550 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.526555 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.526611 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:34.527168 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.527180 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.528756 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.528761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.530670 (+ 1909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.530681 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.531823 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.531830 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.532047 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.532094 (+ 47us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.532936 (+ 842us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.533079 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"thread_start_us":601,"threads_started":1}
I20260923 19:35:34.533488 14963 raft_consensus.cc:2454] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 0.
I20260923 19:35:34.534049 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210830cb2fa74d9f99f9918712d53533" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1" is_pre_election: true
I20260923 19:35:34.534071 14755 leader_election.cc:302] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:34.534300 15107 raft_consensus.cc:2454] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 0.
I20260923 19:35:34.534439 15179 raft_consensus.cc:2781] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:34.534562 15179 raft_consensus.cc:482] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:34.534669 15179 raft_consensus.cc:3037] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:34.537339 15179 raft_consensus.cc:504] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.538017 15179 leader_election.cc:288] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 election: Requested vote from peers ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:34.538407 14963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210830cb2fa74d9f99f9918712d53533" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8be185551c44c6846a2f00bc4515c2"
I20260923 19:35:34.538473 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "210830cb2fa74d9f99f9918712d53533" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1"
I20260923 19:35:34.538625 14963 raft_consensus.cc:3037] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:34.538671 15107 raft_consensus.cc:3037] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:34.541710 14963 raft_consensus.cc:2454] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 1.
I20260923 19:35:34.541685 15107 raft_consensus.cc:2454] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 1.
I20260923 19:35:34.542193 14754 leader_election.cc:302] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, 94f0e62606024529974022d15a2c29e1; no voters:
I20260923 19:35:34.542553 15179 raft_consensus.cc:2781] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:34.543102 15179 raft_consensus.cc:686] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 LEADER]: Becoming Leader. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Running, Role: LEADER
I20260923 19:35:34.543594 15179 consensus_queue.cc:237] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.547250 15195 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: TxnStatusTablet state changed. Reason: New leader 51d7d7a8d5504095b93600d1498b79e6. Latest consensus state: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.547677 15195 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:35:34.548678 15197 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 19:35:34.548995 15197 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 19:35:34.549075 14665 catalog_manager.cc:5495] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } health_report { overall_health: UNKNOWN } } }
I20260923 19:35:34.590253 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.583147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51526 (local address 127.12.159.193:43745)
0923 19:35:34.583369 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.583378 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.583403 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:35:34.583593 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.583597 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.583682 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.583803 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:34.584214 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.585231 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.587306 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.587921 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.588099 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.588730 (+ 631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:34.589523 (+ 793us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:34.589674 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.589761 (+ 87us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.589881 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:35:34.590193 15189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.582935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43745 (local address 127.0.0.1:51526)
0923 19:35:34.583175 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.583195 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.583367 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.583852 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.583858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.583871 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:35:34.584075 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.584086 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.585372 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.585378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.587115 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.587131 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.588150 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.588158 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.588402 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.588482 (+ 80us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:35:34.589632 (+ 1150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:35:34.589654 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.589736 (+ 82us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.589950 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260923 19:35:34.598986 14963 raft_consensus.cc:1261] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Refusing update from remote peer 51d7d7a8d5504095b93600d1498b79e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:34.598986 15107 raft_consensus.cc:1261] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Refusing update from remote peer 51d7d7a8d5504095b93600d1498b79e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:34.599967 15179 consensus_queue.cc:1035] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:34.600327 15195 consensus_queue.cc:1035] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:34.610773 15177 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: TxnStatusTablet state changed. Reason: New leader 51d7d7a8d5504095b93600d1498b79e6. Latest consensus state: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.611233 15177 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:34.616181 15201 mvcc.cc:205] Tried to move back new op lower bound from 7332626983306964992 to 7332626983094407168. Current Snapshot: MvccSnapshot[applied={T|T < 7332626983306964992}]
I20260923 19:35:34.616523 15200 mvcc.cc:205] Tried to move back new op lower bound from 7332626983306964992 to 7332626983094407168. Current Snapshot: MvccSnapshot[applied={T|T < 7332626983306964992}]
I20260923 19:35:34.620452 15177 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.620743 15177 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P ac8be185551c44c6846a2f00bc4515c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:34.621718 15178 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: TxnStatusTablet state changed. Reason: New leader 51d7d7a8d5504095b93600d1498b79e6. Latest consensus state: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.622028 15178 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:34.623944 15195 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.624378 15195 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:35:34.624698 15195 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.624957 15195 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P 51d7d7a8d5504095b93600d1498b79e6: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:35:34.628034 15203 mvcc.cc:205] Tried to move back new op lower bound from 7332626983306964992 to 7332626983094407168. Current Snapshot: MvccSnapshot[applied={T|T < 7332626983306964992}]
I20260923 19:35:34.632849 15178 tablet_replica.cc:439] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } } }
I20260923 19:35:34.633116 15178 tablet_replica.cc:442] T 210830cb2fa74d9f99f9918712d53533 P 94f0e62606024529974022d15a2c29e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:35:34.641124 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.634163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45278 (local address 127.12.159.194:37417)
0923 19:35:34.634909 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.634914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.634927 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:35:34.635010 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.635014 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.635101 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.635268 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:34.635687 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.636856 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.638890 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.639390 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.639495 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.639968 (+ 473us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:34.640509 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:34.640615 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.640750 (+ 135us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.640818 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643}
I20260923 19:35:34.657914 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.651673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:52303 (local address 127.12.159.193:43745)
0923 19:35:34.651908 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.651915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.652300 (+ 385us) server_negotiation.cc:407] Connection header received
0923 19:35:34.652456 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.652461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.652548 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.652649 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:34.653133 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.654360 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.655745 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.656418 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.656548 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.657075 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:34.657246 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:34.657345 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.657465 (+ 120us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.657549 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:35:34.657976 15211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.651515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43745 (local address 127.12.159.194:52303)
0923 19:35:34.652197 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.652217 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.652333 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.652686 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.652689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.652699 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:35:34.652983 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.652991 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.654512 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.654516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.655589 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.655600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.656591 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.656595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.656810 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.656864 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:35:34.657345 (+ 481us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:35:34.657354 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.657417 (+ 63us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.657528 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":364,"threads_started":1}
I20260923 19:35:34.668823 15107 raft_consensus.cc:1261] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Refusing update from remote peer ac8be185551c44c6846a2f00bc4515c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:34.668995 14824 raft_consensus.cc:1261] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Refusing update from remote peer ac8be185551c44c6846a2f00bc4515c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:34.669562 15182 consensus_queue.cc:1035] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:34.670200 15177 consensus_queue.cc:1035] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:34.708976 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.702421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:41701 (local address 127.12.159.194:37417)
0923 19:35:34.702633 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:34.702640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:34.702755 (+ 115us) server_negotiation.cc:407] Connection header received
0923 19:35:34.703033 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:34.703038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:34.703136 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:34.703236 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:34.703939 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.704661 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.707151 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.707671 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.707780 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.708322 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:34.708421 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:34.708490 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:34.708651 (+ 161us) server_negotiation.cc:299] Negotiation successful
0923 19:35:34.708717 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:35:34.709239 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:34.701928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:37417 (local address 127.12.159.193:41701)
0923 19:35:34.702651 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:34.702675 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:34.702868 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:34.703268 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:34.703273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:34.703288 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:35:34.703770 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.703784 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.704816 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.704822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.706844 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:34.706860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:34.707857 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:34.707864 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:34.708054 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:34.708131 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:35:34.708531 (+ 400us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:35:34.708543 (+ 12us) client_negotiation.cc:769] Sending connection context
0923 19:35:34.708648 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:35:34.708803 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":732,"threads_started":1}
I20260923 19:35:34.751490 14667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:34.751799 14667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:34.755896 14667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Sending DeleteTablet for 3 replicas of tablet ce4b18fa48b248f6ae323d5b31ca28fa
I20260923 19:35:34.757040 15082 tablet_service.cc:1514] Processing DeleteTablet for tablet ce4b18fa48b248f6ae323d5b31ca28fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:34 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51530
I20260923 19:35:34.757774 14943 tablet_service.cc:1514] Processing DeleteTablet for tablet ce4b18fa48b248f6ae323d5b31ca28fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:34 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:45270
I20260923 19:35:34.757766 14804 tablet_service.cc:1514] Processing DeleteTablet for tablet ce4b18fa48b248f6ae323d5b31ca28fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:34 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51512
I20260923 19:35:34.765187 14667 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:34.766219 14667 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:34.766868 15222 tablet_replica.cc:330] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: stopping tablet replica
I20260923 19:35:34.767491 15222 raft_consensus.cc:2229] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:34.768234 15222 raft_consensus.cc:2258] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:34.770792 15222 ts_tablet_manager.cc:1905] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:34.772169 15221 tablet_replica.cc:330] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: stopping tablet replica
I20260923 19:35:34.772609 15221 raft_consensus.cc:2229] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:34.772996 15221 raft_consensus.cc:2258] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:34.774559 14804 tablet_service.cc:1467] Processing CreateTablet for tablet 6b995fd3644b4cf0a56bba215746147e (DEFAULT_TABLE table=test-table [id=c51a89e6703b478bbee696ca044f1998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:34.775010 14804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b995fd3644b4cf0a56bba215746147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.775480 15081 tablet_service.cc:1467] Processing CreateTablet for tablet 6b995fd3644b4cf0a56bba215746147e (DEFAULT_TABLE table=test-table [id=c51a89e6703b478bbee696ca044f1998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:34.775951 15081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b995fd3644b4cf0a56bba215746147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.778188 15222 ts_tablet_manager.cc:1918] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:34.778358 15222 log.cc:1196] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/ce4b18fa48b248f6ae323d5b31ca28fa
I20260923 19:35:34.778903 15222 ts_tablet_manager.cc:1939] T ce4b18fa48b248f6ae323d5b31ca28fa P ac8be185551c44c6846a2f00bc4515c2: Deleting consensus metadata
I20260923 19:35:34.780695 14652 catalog_manager.cc:4841] TS ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417): tablet ce4b18fa48b248f6ae323d5b31ca28fa (table test-table [id=707d15a41306483d84b7566df41f24c3]) successfully deleted
I20260923 19:35:34.782819 15221 ts_tablet_manager.cc:1905] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:34.783236 14943 tablet_service.cc:1467] Processing CreateTablet for tablet 6b995fd3644b4cf0a56bba215746147e (DEFAULT_TABLE table=test-table [id=c51a89e6703b478bbee696ca044f1998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:34.783839 14943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b995fd3644b4cf0a56bba215746147e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:34.789965 15172 tablet_bootstrap.cc:492] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: Bootstrap starting.
I20260923 19:35:34.791750 15172 tablet_bootstrap.cc:654] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.794616 15171 tablet_bootstrap.cc:492] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: Bootstrap starting.
I20260923 19:35:34.796389 15171 tablet_bootstrap.cc:654] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.802863 15171 tablet_bootstrap.cc:492] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: No bootstrap required, opened a new log
I20260923 19:35:34.803050 15171 ts_tablet_manager.cc:1397] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20260923 19:35:34.803318 15221 ts_tablet_manager.cc:1918] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:34.803488 15221 log.cc:1196] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/ce4b18fa48b248f6ae323d5b31ca28fa
I20260923 19:35:34.803947 15171 raft_consensus.cc:348] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.804220 15171 raft_consensus.cc:374] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.804352 15171 raft_consensus.cc:729] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f0e62606024529974022d15a2c29e1, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.804379 15172 tablet_bootstrap.cc:492] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: No bootstrap required, opened a new log
I20260923 19:35:34.804538 15172 ts_tablet_manager.cc:1397] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.002s
I20260923 19:35:34.804608 15171 consensus_queue.cc:260] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.805315 15171 ts_tablet_manager.cc:1428] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260923 19:35:34.809883 15172 raft_consensus.cc:348] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.810204 15172 raft_consensus.cc:374] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.810297 15172 raft_consensus.cc:729] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.810693 15173 tablet_bootstrap.cc:492] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: Bootstrap starting.
I20260923 19:35:34.810628 15172 consensus_queue.cc:260] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.812374 15172 ts_tablet_manager.cc:1428] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260923 19:35:34.812443 15173 tablet_bootstrap.cc:654] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:34.812996 15221 ts_tablet_manager.cc:1939] T ce4b18fa48b248f6ae323d5b31ca28fa P 51d7d7a8d5504095b93600d1498b79e6: Deleting consensus metadata
I20260923 19:35:34.814802 14652 catalog_manager.cc:4841] TS 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745): tablet ce4b18fa48b248f6ae323d5b31ca28fa (table test-table [id=707d15a41306483d84b7566df41f24c3]) successfully deleted
I20260923 19:35:34.822387 15173 tablet_bootstrap.cc:492] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: No bootstrap required, opened a new log
I20260923 19:35:34.822717 15173 ts_tablet_manager.cc:1397] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260923 19:35:34.823659 15173 raft_consensus.cc:348] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.823978 15173 raft_consensus.cc:374] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:34.824110 15173 raft_consensus.cc:729] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8be185551c44c6846a2f00bc4515c2, State: Initialized, Role: FOLLOWER
I20260923 19:35:34.824453 15173 consensus_queue.cc:260] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:34.829057 15173 ts_tablet_manager.cc:1428] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:35:34.832291 15220 tablet_replica.cc:330] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: stopping tablet replica
I20260923 19:35:34.832841 15220 raft_consensus.cc:2229] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:34.833266 15220 raft_consensus.cc:2258] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:34.835425 15220 ts_tablet_manager.cc:1905] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:34.844025 15220 ts_tablet_manager.cc:1918] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:34.844221 15220 log.cc:1196] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/ce4b18fa48b248f6ae323d5b31ca28fa
I20260923 19:35:34.844770 15220 ts_tablet_manager.cc:1939] T ce4b18fa48b248f6ae323d5b31ca28fa P 94f0e62606024529974022d15a2c29e1: Deleting consensus metadata
I20260923 19:35:34.846783 14651 catalog_manager.cc:4841] TS 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675): tablet ce4b18fa48b248f6ae323d5b31ca28fa (table test-table [id=707d15a41306483d84b7566df41f24c3]) successfully deleted
I20260923 19:35:35.003201 15195 raft_consensus.cc:482] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:35.003491 15195 raft_consensus.cc:504] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:35.004261 15195 leader_election.cc:288] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:35.004957 14963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b995fd3644b4cf0a56bba215746147e" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8be185551c44c6846a2f00bc4515c2" is_pre_election: true
I20260923 19:35:35.005054 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b995fd3644b4cf0a56bba215746147e" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1" is_pre_election: true
I20260923 19:35:35.005201 14963 raft_consensus.cc:2454] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 0.
I20260923 19:35:35.005294 15107 raft_consensus.cc:2454] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 0.
I20260923 19:35:35.005679 14755 leader_election.cc:302] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:35.006121 15195 raft_consensus.cc:2781] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:35.006220 15195 raft_consensus.cc:482] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:35.006315 15195 raft_consensus.cc:3037] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:35.009559 15195 raft_consensus.cc:504] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:35.010783 14963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b995fd3644b4cf0a56bba215746147e" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8be185551c44c6846a2f00bc4515c2"
I20260923 19:35:35.011019 14963 raft_consensus.cc:3037] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:35.011864 15195 leader_election.cc:288] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 election: Requested vote from peers ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:35.012848 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b995fd3644b4cf0a56bba215746147e" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1"
I20260923 19:35:35.013084 15107 raft_consensus.cc:3037] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:35.014235 14963 raft_consensus.cc:2454] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 1.
I20260923 19:35:35.014720 14755 leader_election.cc:302] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:35.015112 15195 raft_consensus.cc:2781] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:35.015350 15195 raft_consensus.cc:686] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 1 LEADER]: Becoming Leader. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Running, Role: LEADER
I20260923 19:35:35.015641 15195 consensus_queue.cc:237] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:35.016566 15107 raft_consensus.cc:2454] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 1.
I20260923 19:35:35.019467 14665 catalog_manager.cc:5495] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } health_report { overall_health: UNKNOWN } } }
I20260923 19:35:35.046842 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:35.042130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.12.159.193:43745)
0923 19:35:35.042289 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:35.042297 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:35.042316 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:35:35.042532 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:35.042538 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:35.042619 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:35.042723 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:35.043088 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:35.043791 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:35.045075 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:35.045501 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:35.045642 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:35.046172 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:35.046273 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:35.046371 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:35.046498 (+ 127us) server_negotiation.cc:299] Negotiation successful
0923 19:35:35.046580 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 19:35:35.059875 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:35.054606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:55357 (local address 127.12.159.193:43745)
0923 19:35:35.054747 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:35.054751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:35.054848 (+ 97us) server_negotiation.cc:407] Connection header received
0923 19:35:35.055026 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:35.055030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:35.055086 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:35.055154 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:35.055535 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:35.056227 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:35.058210 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:35.058622 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:35.058733 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:35.059232 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:35.059352 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:35.059435 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:35.059603 (+ 168us) server_negotiation.cc:299] Negotiation successful
0923 19:35:35.059663 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260923 19:35:35.060105 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:35.054541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43745 (local address 127.12.159.193:55357)
0923 19:35:35.054756 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:35.054776 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:35.054901 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:35.055198 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:35.055204 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:35.055217 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:35:35.055410 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:35.055422 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:35.056375 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:35.056382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:35.058058 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:35.058074 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:35.058781 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:35.058788 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:35.058970 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:35.059033 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:35:35.059467 (+ 434us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:35:35.059482 (+ 15us) client_negotiation.cc:769] Sending connection context
0923 19:35:35.059578 (+ 96us) client_negotiation.cc:240] Negotiation successful
0923 19:35:35.059728 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260923 19:35:35.069026 15107 raft_consensus.cc:1261] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Refusing update from remote peer 51d7d7a8d5504095b93600d1498b79e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:35.069437 14962 raft_consensus.cc:1261] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Refusing update from remote peer 51d7d7a8d5504095b93600d1498b79e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:35.070122 15228 consensus_queue.cc:1035] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:35.070489 15179 consensus_queue.cc:1035] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:35:35.102775 15200 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 19:35:36.704457 14667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:36.704793 14667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:36.709170 14667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Sending DeleteTablet for 3 replicas of tablet 6b995fd3644b4cf0a56bba215746147e
I20260923 19:35:36.710042 14804 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b995fd3644b4cf0a56bba215746147e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51512
I20260923 19:35:36.710142 14943 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b995fd3644b4cf0a56bba215746147e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:45270
I20260923 19:35:36.710425 15082 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b995fd3644b4cf0a56bba215746147e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51530
I20260923 19:35:36.722764 15251 tablet_replica.cc:330] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: stopping tablet replica
I20260923 19:35:36.722887 15253 tablet_replica.cc:330] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: stopping tablet replica
I20260923 19:35:36.723320 15251 raft_consensus.cc:2229] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:36.723304 15253 raft_consensus.cc:2229] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:36.723767 15253 raft_consensus.cc:2258] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:36.724061 15251 raft_consensus.cc:2258] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:36.724797 15252 tablet_replica.cc:330] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: stopping tablet replica
I20260923 19:35:36.725015 15252 raft_consensus.cc:2229] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:36.725224 15253 ts_tablet_manager.cc:1905] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:36.725267 15252 raft_consensus.cc:2258] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:36.726130 15251 ts_tablet_manager.cc:1905] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:36.726342 15252 ts_tablet_manager.cc:1905] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:36.732880 15251 ts_tablet_manager.cc:1918] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:35:36.732880 15252 ts_tablet_manager.cc:1918] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:35:36.732920 15253 ts_tablet_manager.cc:1918] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:35:36.733021 15252 log.cc:1196] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/6b995fd3644b4cf0a56bba215746147e
I20260923 19:35:36.733057 15253 log.cc:1196] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/6b995fd3644b4cf0a56bba215746147e
I20260923 19:35:36.733132 15251 log.cc:1196] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/6b995fd3644b4cf0a56bba215746147e
I20260923 19:35:36.733577 15252 ts_tablet_manager.cc:1939] T 6b995fd3644b4cf0a56bba215746147e P ac8be185551c44c6846a2f00bc4515c2: Deleting consensus metadata
I20260923 19:35:36.733580 15253 ts_tablet_manager.cc:1939] T 6b995fd3644b4cf0a56bba215746147e P 94f0e62606024529974022d15a2c29e1: Deleting consensus metadata
I20260923 19:35:36.733640 15251 ts_tablet_manager.cc:1939] T 6b995fd3644b4cf0a56bba215746147e P 51d7d7a8d5504095b93600d1498b79e6: Deleting consensus metadata
I20260923 19:35:36.734831 14651 catalog_manager.cc:4841] TS 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675): tablet 6b995fd3644b4cf0a56bba215746147e (table test-table [id=c51a89e6703b478bbee696ca044f1998]) successfully deleted
I20260923 19:35:36.734838 14652 catalog_manager.cc:4841] TS ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417): tablet 6b995fd3644b4cf0a56bba215746147e (table test-table [id=c51a89e6703b478bbee696ca044f1998]) successfully deleted
I20260923 19:35:36.735211 14652 catalog_manager.cc:4841] TS 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745): tablet 6b995fd3644b4cf0a56bba215746147e (table test-table [id=c51a89e6703b478bbee696ca044f1998]) successfully deleted
Sep 23 19:35:36 dist-test-slave-lzv7 krb5kdc[14622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192136, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:35:36 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192136, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:36.769001 15261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:36.755505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36334 (local address 127.12.159.254:44669)
0923 19:35:36.756047 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:36.756051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:36.756145 (+ 94us) server_negotiation.cc:407] Connection header received
0923 19:35:36.756295 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:36.756299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:36.756362 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:36.756456 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:36.757749 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:36.758669 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:36.759844 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:36.760232 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:36.760330 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:36.764136 (+ 3806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:36.764141 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:36.764145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:36.764178 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:36.766725 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:36.767345 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:36.767349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:36.767351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:36.767460 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:36.767766 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:36.767768 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:36.767770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:36.768009 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:36.768180 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:36.768460 (+ 280us) server_negotiation.cc:299] Negotiation successful
0923 19:35:36.768625 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":270,"threads_started":1}
I20260923 19:35:36.772773 14667 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:36.773464 14667 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:36.780081 14804 tablet_service.cc:1467] Processing CreateTablet for tablet 85c36a19710a414499539b2176b6ae22 (DEFAULT_TABLE table=test-table [id=c8608945264e4be3b70f67ac98bfaf7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:36.780148 14943 tablet_service.cc:1467] Processing CreateTablet for tablet 85c36a19710a414499539b2176b6ae22 (DEFAULT_TABLE table=test-table [id=c8608945264e4be3b70f67ac98bfaf7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:36.780577 14804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85c36a19710a414499539b2176b6ae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:36.780625 14943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85c36a19710a414499539b2176b6ae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:36.780543 15082 tablet_service.cc:1467] Processing CreateTablet for tablet 85c36a19710a414499539b2176b6ae22 (DEFAULT_TABLE table=test-table [id=c8608945264e4be3b70f67ac98bfaf7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:36.780936 15082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85c36a19710a414499539b2176b6ae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:36.785650 15262 tablet_bootstrap.cc:492] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: Bootstrap starting.
I20260923 19:35:36.787014 15262 tablet_bootstrap.cc:654] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:36.787588 15264 tablet_bootstrap.cc:492] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: Bootstrap starting.
I20260923 19:35:36.789429 15264 tablet_bootstrap.cc:654] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:36.789988 15262 tablet_bootstrap.cc:492] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: No bootstrap required, opened a new log
I20260923 19:35:36.790593 15263 tablet_bootstrap.cc:492] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: Bootstrap starting.
I20260923 19:35:36.790192 15262 ts_tablet_manager.cc:1397] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 19:35:36.792116 15263 tablet_bootstrap.cc:654] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:36.792141 15262 raft_consensus.cc:348] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.792472 15262 raft_consensus.cc:374] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:36.792589 15262 raft_consensus.cc:729] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Initialized, Role: FOLLOWER
I20260923 19:35:36.792936 15262 consensus_queue.cc:260] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.793852 15262 ts_tablet_manager.cc:1428] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:36.795668 15264 tablet_bootstrap.cc:492] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: No bootstrap required, opened a new log
I20260923 19:35:36.795840 15264 ts_tablet_manager.cc:1397] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260923 19:35:36.796604 15264 raft_consensus.cc:348] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.796815 15264 raft_consensus.cc:374] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:36.796937 15264 raft_consensus.cc:729] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f0e62606024529974022d15a2c29e1, State: Initialized, Role: FOLLOWER
I20260923 19:35:36.797227 15264 consensus_queue.cc:260] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.798156 15264 ts_tablet_manager.cc:1428] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260923 19:35:36.800153 15263 tablet_bootstrap.cc:492] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: No bootstrap required, opened a new log
I20260923 19:35:36.800427 15263 ts_tablet_manager.cc:1397] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260923 19:35:36.801084 15263 raft_consensus.cc:348] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.801302 15263 raft_consensus.cc:374] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:36.801395 15263 raft_consensus.cc:729] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8be185551c44c6846a2f00bc4515c2, State: Initialized, Role: FOLLOWER
I20260923 19:35:36.801630 15263 consensus_queue.cc:260] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.802400 15263 ts_tablet_manager.cc:1428] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260923 19:35:36.827030 15269 raft_consensus.cc:482] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:36.827342 15269 raft_consensus.cc:504] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.828087 15269 leader_election.cc:288] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:36.828701 14824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c36a19710a414499539b2176b6ae22" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d7d7a8d5504095b93600d1498b79e6" is_pre_election: true
I20260923 19:35:36.828758 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c36a19710a414499539b2176b6ae22" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1" is_pre_election: true
I20260923 19:35:36.828940 14824 raft_consensus.cc:2454] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 0.
I20260923 19:35:36.829077 15107 raft_consensus.cc:2454] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 0.
I20260923 19:35:36.829416 14895 leader_election.cc:302] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:36.829699 15269 raft_consensus.cc:2781] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:36.829851 15269 raft_consensus.cc:482] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:36.829957 15269 raft_consensus.cc:3037] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:36.832474 15269 raft_consensus.cc:504] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.833019 15269 leader_election.cc:288] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 election: Requested vote from peers 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:36.833515 14824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c36a19710a414499539b2176b6ae22" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51d7d7a8d5504095b93600d1498b79e6"
I20260923 19:35:36.833546 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85c36a19710a414499539b2176b6ae22" candidate_uuid: "ac8be185551c44c6846a2f00bc4515c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1"
I20260923 19:35:36.833734 14824 raft_consensus.cc:3037] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:36.833763 15107 raft_consensus.cc:3037] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:36.835786 15107 raft_consensus.cc:2454] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 1.
I20260923 19:35:36.835804 14824 raft_consensus.cc:2454] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8be185551c44c6846a2f00bc4515c2 in term 1.
I20260923 19:35:36.836242 14894 leader_election.cc:302] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f0e62606024529974022d15a2c29e1, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:36.836548 15269 raft_consensus.cc:2781] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:36.837037 15269 raft_consensus.cc:686] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 1 LEADER]: Becoming Leader. State: Replica: ac8be185551c44c6846a2f00bc4515c2, State: Running, Role: LEADER
I20260923 19:35:36.837407 15269 consensus_queue.cc:237] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.839910 14667 catalog_manager.cc:5495] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194). New cstate: current_term: 1 leader_uuid: "ac8be185551c44c6846a2f00bc4515c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } health_report { overall_health: UNKNOWN } } }
I20260923 19:35:36.872668 15273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:36.867311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45290 (local address 127.12.159.194:37417)
0923 19:35:36.867870 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:36.867874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:36.867891 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:35:36.867942 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:36.867945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:36.868004 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:36.868116 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:36.868498 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:36.869257 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:36.870676 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:36.871230 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:36.871382 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:36.871819 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:36.871945 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:36.872036 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:36.872223 (+ 187us) server_negotiation.cc:299] Negotiation successful
0923 19:35:36.872301 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":292,"threads_started":1}
I20260923 19:35:36.881309 15107 raft_consensus.cc:1261] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Refusing update from remote peer ac8be185551c44c6846a2f00bc4515c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:36.881484 14824 raft_consensus.cc:1261] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Refusing update from remote peer ac8be185551c44c6846a2f00bc4515c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:36.882113 15269 consensus_queue.cc:1035] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:36.882398 15270 consensus_queue.cc:1035] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:36.927029 14667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:36.927327 14667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:36.930155 14667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Sending DeleteTablet for 3 replicas of tablet 85c36a19710a414499539b2176b6ae22
I20260923 19:35:36.931120 14943 tablet_service.cc:1514] Processing DeleteTablet for tablet 85c36a19710a414499539b2176b6ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:45270
I20260923 19:35:36.931136 14804 tablet_service.cc:1514] Processing DeleteTablet for tablet 85c36a19710a414499539b2176b6ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51512
I20260923 19:35:36.931241 15082 tablet_service.cc:1514] Processing DeleteTablet for tablet 85c36a19710a414499539b2176b6ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51530
I20260923 19:35:36.931447 15252 tablet_replica.cc:330] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: stopping tablet replica
I20260923 19:35:36.931505 15253 tablet_replica.cc:330] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: stopping tablet replica
I20260923 19:35:36.931660 15252 raft_consensus.cc:2229] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:36.931690 15251 tablet_replica.cc:330] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: stopping tablet replica
I20260923 19:35:36.931717 15253 raft_consensus.cc:2229] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:36.931887 15251 raft_consensus.cc:2229] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:36.931918 15253 raft_consensus.cc:2258] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:36.931999 15252 raft_consensus.cc:2258] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:36.932058 15251 raft_consensus.cc:2258] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:36.932219 14667 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:36.932904 14667 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:36.933127 15253 ts_tablet_manager.cc:1905] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:36.933331 15252 ts_tablet_manager.cc:1905] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:36.933331 15251 ts_tablet_manager.cc:1905] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:36.939116 15253 ts_tablet_manager.cc:1918] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:36.939296 15253 log.cc:1196] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/85c36a19710a414499539b2176b6ae22
I20260923 19:35:36.939661 15253 ts_tablet_manager.cc:1939] T 85c36a19710a414499539b2176b6ae22 P 94f0e62606024529974022d15a2c29e1: Deleting consensus metadata
I20260923 19:35:36.939831 15252 ts_tablet_manager.cc:1918] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:36.939991 15252 log.cc:1196] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/85c36a19710a414499539b2176b6ae22
I20260923 19:35:36.940255 15251 ts_tablet_manager.cc:1918] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:35:36.940403 15252 ts_tablet_manager.cc:1939] T 85c36a19710a414499539b2176b6ae22 P ac8be185551c44c6846a2f00bc4515c2: Deleting consensus metadata
I20260923 19:35:36.940410 15251 log.cc:1196] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/85c36a19710a414499539b2176b6ae22
I20260923 19:35:36.940794 15251 ts_tablet_manager.cc:1939] T 85c36a19710a414499539b2176b6ae22 P 51d7d7a8d5504095b93600d1498b79e6: Deleting consensus metadata
I20260923 19:35:36.940778 14651 catalog_manager.cc:4841] TS 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675): tablet 85c36a19710a414499539b2176b6ae22 (table test-table [id=c8608945264e4be3b70f67ac98bfaf7e]) successfully deleted
I20260923 19:35:36.941511 14652 catalog_manager.cc:4841] TS ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417): tablet 85c36a19710a414499539b2176b6ae22 (table test-table [id=c8608945264e4be3b70f67ac98bfaf7e]) successfully deleted
I20260923 19:35:36.941751 14652 catalog_manager.cc:4841] TS 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745): tablet 85c36a19710a414499539b2176b6ae22 (table test-table [id=c8608945264e4be3b70f67ac98bfaf7e]) successfully deleted
I20260923 19:35:36.944914 14804 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9a38113b55439a9ecae73cacf4be36 (DEFAULT_TABLE table=test-table [id=06dc231e8af649eda1567481b03dbad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:36.945091 14943 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9a38113b55439a9ecae73cacf4be36 (DEFAULT_TABLE table=test-table [id=06dc231e8af649eda1567481b03dbad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:36.945346 14804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9a38113b55439a9ecae73cacf4be36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:36.945290 15082 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9a38113b55439a9ecae73cacf4be36 (DEFAULT_TABLE table=test-table [id=06dc231e8af649eda1567481b03dbad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:36.945467 14943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9a38113b55439a9ecae73cacf4be36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:36.945611 15082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9a38113b55439a9ecae73cacf4be36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:36.950621 15264 tablet_bootstrap.cc:492] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: Bootstrap starting.
I20260923 19:35:36.951776 15262 tablet_bootstrap.cc:492] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: Bootstrap starting.
I20260923 19:35:36.951781 15263 tablet_bootstrap.cc:492] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: Bootstrap starting.
I20260923 19:35:36.952273 15264 tablet_bootstrap.cc:654] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:36.953074 15263 tablet_bootstrap.cc:654] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:36.953505 15262 tablet_bootstrap.cc:654] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:36.954511 15264 tablet_bootstrap.cc:492] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: No bootstrap required, opened a new log
I20260923 19:35:36.955281 15264 ts_tablet_manager.cc:1397] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:35:36.955570 15263 tablet_bootstrap.cc:492] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: No bootstrap required, opened a new log
I20260923 19:35:36.955639 15262 tablet_bootstrap.cc:492] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: No bootstrap required, opened a new log
I20260923 19:35:36.955760 15263 ts_tablet_manager.cc:1397] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:35:36.955783 15262 ts_tablet_manager.cc:1397] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260923 19:35:36.956144 15264 raft_consensus.cc:348] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.956409 15264 raft_consensus.cc:374] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:36.956494 15264 raft_consensus.cc:729] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f0e62606024529974022d15a2c29e1, State: Initialized, Role: FOLLOWER
I20260923 19:35:36.956341 15263 raft_consensus.cc:348] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.956645 15263 raft_consensus.cc:374] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:36.956748 15263 raft_consensus.cc:729] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8be185551c44c6846a2f00bc4515c2, State: Initialized, Role: FOLLOWER
I20260923 19:35:36.956552 15262 raft_consensus.cc:348] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.956802 15264 consensus_queue.cc:260] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.957005 15262 raft_consensus.cc:374] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:36.957094 15262 raft_consensus.cc:729] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Initialized, Role: FOLLOWER
I20260923 19:35:36.956985 15263 consensus_queue.cc:260] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.957325 15262 consensus_queue.cc:260] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:36.957531 15263 ts_tablet_manager.cc:1428] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:35:36.957895 15262 ts_tablet_manager.cc:1428] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260923 19:35:36.958084 15264 ts_tablet_manager.cc:1428] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:35:37.270005 15234 raft_consensus.cc:482] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:37.270264 15234 raft_consensus.cc:504] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:37.271036 15234 leader_election.cc:288] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:37.271579 14963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9a38113b55439a9ecae73cacf4be36" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8be185551c44c6846a2f00bc4515c2" is_pre_election: true
I20260923 19:35:37.271622 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9a38113b55439a9ecae73cacf4be36" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1" is_pre_election: true
I20260923 19:35:37.271847 14963 raft_consensus.cc:2454] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 0.
I20260923 19:35:37.271870 15107 raft_consensus.cc:2454] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 0.
I20260923 19:35:37.272369 14754 leader_election.cc:302] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, 94f0e62606024529974022d15a2c29e1; no voters:
I20260923 19:35:37.272636 15234 raft_consensus.cc:2781] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:37.272769 15234 raft_consensus.cc:482] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:37.272884 15234 raft_consensus.cc:3037] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:37.274984 15234 raft_consensus.cc:504] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:37.275556 15234 leader_election.cc:288] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 election: Requested vote from peers ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417), 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675)
I20260923 19:35:37.276037 14963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9a38113b55439a9ecae73cacf4be36" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8be185551c44c6846a2f00bc4515c2"
I20260923 19:35:37.276086 15107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9a38113b55439a9ecae73cacf4be36" candidate_uuid: "51d7d7a8d5504095b93600d1498b79e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f0e62606024529974022d15a2c29e1"
I20260923 19:35:37.276262 14963 raft_consensus.cc:3037] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:37.276392 15107 raft_consensus.cc:3037] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:37.278438 14963 raft_consensus.cc:2454] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 1.
I20260923 19:35:37.278497 15107 raft_consensus.cc:2454] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d7d7a8d5504095b93600d1498b79e6 in term 1.
I20260923 19:35:37.278887 14755 leader_election.cc:302] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d7d7a8d5504095b93600d1498b79e6, ac8be185551c44c6846a2f00bc4515c2; no voters:
I20260923 19:35:37.279219 15234 raft_consensus.cc:2781] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:37.279390 15234 raft_consensus.cc:686] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 LEADER]: Becoming Leader. State: Replica: 51d7d7a8d5504095b93600d1498b79e6, State: Running, Role: LEADER
I20260923 19:35:37.279683 15234 consensus_queue.cc:237] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } }
I20260923 19:35:37.282363 14666 catalog_manager.cc:5495] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "51d7d7a8d5504095b93600d1498b79e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d7d7a8d5504095b93600d1498b79e6" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 } health_report { overall_health: UNKNOWN } } }
I20260923 19:35:37.334347 15283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:37.329351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.12.159.193:43745)
0923 19:35:37.329890 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:37.329903 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:37.329922 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:35:37.329974 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:37.329977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:37.330037 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:37.330119 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:37.330540 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:37.331269 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:37.332535 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:37.332938 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:37.333026 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:37.333458 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:37.333566 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:37.333634 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:37.333916 (+ 282us) server_negotiation.cc:299] Negotiation successful
0923 19:35:37.333977 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":493,"threads_started":1}
I20260923 19:35:37.343961 14963 raft_consensus.cc:1261] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Refusing update from remote peer 51d7d7a8d5504095b93600d1498b79e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:37.343981 15107 raft_consensus.cc:1261] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Refusing update from remote peer 51d7d7a8d5504095b93600d1498b79e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:37.344542 15234 consensus_queue.cc:1035] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f0e62606024529974022d15a2c29e1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:37.344897 15239 consensus_queue.cc:1035] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8be185551c44c6846a2f00bc4515c2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:35:37.367962 15232 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 19:35:38.950806 14667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:38.951009 14667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:38.955175 14667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c2ce116c1fa4967a6fb967d193e9464: Sending DeleteTablet for 3 replicas of tablet 7f9a38113b55439a9ecae73cacf4be36
I20260923 19:35:38.956157 14943 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9a38113b55439a9ecae73cacf4be36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:38 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:45270
I20260923 19:35:38.956238 15082 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9a38113b55439a9ecae73cacf4be36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:38 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51530
I20260923 19:35:38.956235 14803 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9a38113b55439a9ecae73cacf4be36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:38 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51512
I20260923 19:35:38.956825 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14738
I20260923 19:35:38.965178 15309 tablet_replica.cc:330] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: stopping tablet replica
I20260923 19:35:38.965466 15309 raft_consensus.cc:2229] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:38.965993 15309 raft_consensus.cc:2258] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:38.967067 15309 ts_tablet_manager.cc:1905] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:38.968866 15307 tablet_replica.cc:330] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: stopping tablet replica
I20260923 19:35:38.969089 15307 raft_consensus.cc:2229] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:38.969332 15307 raft_consensus.cc:2258] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:38.969970 15308 tablet_replica.cc:330] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: stopping tablet replica
I20260923 19:35:38.970287 15308 raft_consensus.cc:2229] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:38.970571 15308 raft_consensus.cc:2258] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:38.970851 15307 ts_tablet_manager.cc:1905] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:38.972034 15308 ts_tablet_manager.cc:1905] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:38.974162 15309 ts_tablet_manager.cc:1918] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:35:38.974359 15309 log.cc:1196] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/7f9a38113b55439a9ecae73cacf4be36
I20260923 19:35:38.974886 15309 ts_tablet_manager.cc:1939] T 7f9a38113b55439a9ecae73cacf4be36 P 51d7d7a8d5504095b93600d1498b79e6: Deleting consensus metadata
Sep 23 19:35:38 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192136, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:38.976092 14652 catalog_manager.cc:4841] TS 51d7d7a8d5504095b93600d1498b79e6 (127.12.159.193:43745): tablet 7f9a38113b55439a9ecae73cacf4be36 (table test-table [id=06dc231e8af649eda1567481b03dbad7]) successfully deleted
I20260923 19:35:38.977262 15307 ts_tablet_manager.cc:1918] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:35:38.977473 15307 log.cc:1196] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/7f9a38113b55439a9ecae73cacf4be36
I20260923 19:35:38.977985 15307 ts_tablet_manager.cc:1939] T 7f9a38113b55439a9ecae73cacf4be36 P ac8be185551c44c6846a2f00bc4515c2: Deleting consensus metadata
I20260923 19:35:38.979003 14652 catalog_manager.cc:4841] TS ac8be185551c44c6846a2f00bc4515c2 (127.12.159.194:37417): tablet 7f9a38113b55439a9ecae73cacf4be36 (table test-table [id=06dc231e8af649eda1567481b03dbad7]) successfully deleted
I20260923 19:35:38.979475 15308 ts_tablet_manager.cc:1918] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:35:38.979615 15308 log.cc:1196] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/7f9a38113b55439a9ecae73cacf4be36
I20260923 19:35:38.980050 15308 ts_tablet_manager.cc:1939] T 7f9a38113b55439a9ecae73cacf4be36 P 94f0e62606024529974022d15a2c29e1: Deleting consensus metadata
I20260923 19:35:38.981132 14651 catalog_manager.cc:4841] TS 94f0e62606024529974022d15a2c29e1 (127.12.159.195:37675): tablet 7f9a38113b55439a9ecae73cacf4be36 (table test-table [id=06dc231e8af649eda1567481b03dbad7]) successfully deleted
I20260923 19:35:38.983645 15311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:38.960322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57750 (local address 127.12.159.193:43745)
0923 19:35:38.964907 (+ 4585us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:38.964917 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:38.964948 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:35:38.965022 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:38.965027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:38.965115 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:38.965230 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:38.967122 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:38.968253 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:38.970114 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:38.970802 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:38.976309 (+ 5507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:38.976624 (+ 315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:38.976640 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:38.976662 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:38.976703 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:38.980718 (+ 4015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:38.981514 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:38.981522 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:38.981524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:38.981649 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:38.982150 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:38.982154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:38.982156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:38.982533 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:38.982738 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:38.983058 (+ 320us) server_negotiation.cc:299] Negotiation successful
0923 19:35:38.983269 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4437,"thread_start_us":4266,"threads_started":1}
W20260923 19:35:38.984325 14869 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57750
W20260923 19:35:38.984947 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14738: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:38.985174 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 14738
I20260923 19:35:39.012205 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14878
Sep 23 19:35:39 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192136, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:35:39.029397 15312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:39.013131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52124 (local address 127.12.159.194:37417)
0923 19:35:39.013666 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:39.013670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:39.013688 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:35:39.013743 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:39.013747 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:39.013864 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:39.013967 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:39.015341 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:39.016116 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:39.017454 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:39.017978 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:39.018105 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:39.022850 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:39.022866 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:39.022883 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:39.022926 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:39.026468 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:39.027233 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:39.027240 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:39.027243 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:39.027420 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:39.027743 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:39.027746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:39.027748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:39.028234 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:39.028446 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:39.028716 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 19:35:39.028893 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":281,"threads_started":1}
W20260923 19:35:39.030304 15008 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52124
W20260923 19:35:39.030969 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14878: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:39.031172 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 14878
I20260923 19:35:39.054073 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15017
Sep 23 19:35:39 dist-test-slave-lzv7 krb5kdc[14622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192136, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:35:39.070132 15313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:39.054902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52232 (local address 127.12.159.195:37675)
0923 19:35:39.055427 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:39.055431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:39.055447 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:35:39.055500 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:39.055504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:39.055581 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:39.055676 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:39.056916 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:39.057704 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:39.058958 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:39.059436 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:39.059546 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:39.064204 (+ 4658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:39.064221 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:39.064237 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:39.064279 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:39.067199 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:39.067967 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:39.067975 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:39.067978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:39.068128 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:39.068526 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:39.068531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:39.068534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:39.068879 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:39.069241 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:39.069520 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 19:35:39.069752 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":302,"threads_started":1}
W20260923 19:35:39.070886 15147 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52232
W20260923 19:35:39.071535 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15017: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:39.071738 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 15017
I20260923 19:35:39.089738 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 14635
I20260923 19:35:39.091116 14707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:39.208205 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 14635
2026-09-23T19:35:39Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8562 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:39 dist-test-slave-lzv7 krb5kdc[15317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:39 dist-test-slave-lzv7 krb5kdc[15317](info): set up 2 sockets
Sep 23 19:35:39 dist-test-slave-lzv7 krb5kdc[15317](info): commencing operation
krb5kdc: starting...
W20260923 19:35:40.382211 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:40 dist-test-slave-lzv7 krb5kdc[15317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:40.578248 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33087
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:40.905639 15330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:40.905975 15330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:40.906136 15330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:40.913492 15330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:40.913607 15330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:40.913700 15330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:40.913792 15330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:40.913888 15330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:40.924021 15330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:40.925514 15330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:40.926896 15330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:40.939685 15336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:40.939622 15338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:40.939656 15335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:40.940459 15330 server_base.cc:1034] running on GCE node
I20260923 19:35:40.941288 15330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:40.942788 15330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:40.943991 15330 hybrid_clock.cc:648] HybridClock initialized: now 1790192140943944 us; error 33 us; skew 500 ppm
I20260923 19:35:40.944347 15330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:40 dist-test-slave-lzv7 krb5kdc[15317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192140, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:40.953351 15330 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:40.955252 15330 webserver.cc:460] Webserver started at http://127.12.159.254:44121/ using document root <none> and password file <none>
I20260923 19:35:40.956358 15330 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:40.956514 15330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:40.956949 15330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:40.961879 15330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738"
format_stamp: "Formatted at 2026-09-23 19:35:40 on dist-test-slave-lzv7"
server_key: "95899bee75552c023806b75447bc6c43"
server_key_iv: "62d784b3d4a5a45bcf66b0e9f2251035"
server_key_version: "encryptionkey@0"
I20260923 19:35:40.963114 15330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738"
format_stamp: "Formatted at 2026-09-23 19:35:40 on dist-test-slave-lzv7"
server_key: "95899bee75552c023806b75447bc6c43"
server_key_iv: "62d784b3d4a5a45bcf66b0e9f2251035"
server_key_version: "encryptionkey@0"
I20260923 19:35:40.971009 15330 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.008s
I20260923 19:35:40.976132 15345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:40.978540 15330 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260923 19:35:40.978765 15330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738"
format_stamp: "Formatted at 2026-09-23 19:35:40 on dist-test-slave-lzv7"
server_key: "95899bee75552c023806b75447bc6c43"
server_key_iv: "62d784b3d4a5a45bcf66b0e9f2251035"
server_key_version: "encryptionkey@0"
I20260923 19:35:40.979018 15330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:41.013864 15330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:41.018461 15330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:41.018725 15330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:41.040083 15330 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:33087
I20260923 19:35:41.040110 15396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:33087 every 8 connection(s)
I20260923 19:35:41.042178 15330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:41.047463 15397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:41.047784 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 15330
I20260923 19:35:41.048055 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:41.048954 12927 external_mini_cluster.cc:1428] Setting key bfa3b1c45f7f0628122c9d7e6d964669
I20260923 19:35:41.061622 15397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738: Bootstrap starting.
Sep 23 19:35:41 dist-test-slave-lzv7 krb5kdc[15317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:41.065116 15397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:41.066275 15397 log.cc:824] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:41.069398 15397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738: No bootstrap required, opened a new log
I20260923 19:35:41.073566 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:41.051124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57382 (local address 127.12.159.254:33087)
0923 19:35:41.052034 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:41.052051 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:41.052121 (+ 70us) server_negotiation.cc:407] Connection header received
0923 19:35:41.055362 (+ 3241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:41.055388 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:41.055807 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:41.056222 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:41.057673 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:41.059135 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:41.060516 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:41.061197 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:41.061397 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:41.065681 (+ 4284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:41.065689 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:41.065704 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:41.065746 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:41.068966 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:41.069652 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:41.069659 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:41.069668 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:41.069897 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:41.070314 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:41.070320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:41.070323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:41.071023 (+ 700us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:41.071318 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:41.071708 (+ 390us) server_negotiation.cc:299] Negotiation successful
0923 19:35:41.072162 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":341,"threads_started":1}
I20260923 19:35:41.078943 15397 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33087 } }
I20260923 19:35:41.079288 15397 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:41.079358 15397 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2fb7dd986a34dd9a2b5dfb8cbbf6738, State: Initialized, Role: FOLLOWER
I20260923 19:35:41.079836 15397 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33087 } }
I20260923 19:35:41.080032 15397 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:41.080121 15397 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:41.080233 15397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:41.082656 15397 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33087 } }
I20260923 19:35:41.083086 15397 leader_election.cc:302] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2fb7dd986a34dd9a2b5dfb8cbbf6738; no voters:
I20260923 19:35:41.083623 15397 leader_election.cc:288] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:41.083811 15402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:41.084602 15402 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [term 1 LEADER]: Becoming Leader. State: Replica: f2fb7dd986a34dd9a2b5dfb8cbbf6738, State: Running, Role: LEADER
I20260923 19:35:41.085116 15402 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33087 } }
I20260923 19:35:41.085956 15397 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:41.088179 15404 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2fb7dd986a34dd9a2b5dfb8cbbf6738. Latest consensus state: current_term: 1 leader_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33087 } } }
I20260923 19:35:41.088631 15404 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:41.089578 15403 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2fb7dd986a34dd9a2b5dfb8cbbf6738" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33087 } } }
I20260923 19:35:41.089869 15403 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:41.090384 15409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:41.095295 15409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:41.104254 15409 catalog_manager.cc:1347] Generated new cluster ID: d75ae7f6ab4141c1bc32863c0892e2c2
I20260923 19:35:41.104377 15409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:41.135891 15409 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:41.137773 15409 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:41.146999 15409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2fb7dd986a34dd9a2b5dfb8cbbf6738: Generated new TSK 0
I20260923 19:35:41.148088 15409 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:41.205853 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33087
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:41.538926 15423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:41.539192 15423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:41.539352 15423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:41.546780 15423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:41.546919 15423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:41.547111 15423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:41.556813 15423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:41.558146 15423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:41.559473 15423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:41.573045 15431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:41.572988 15429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:41.572963 15428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:41.579485 15423 server_base.cc:1034] running on GCE node
I20260923 19:35:41.580183 15423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:41.581211 15423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:41.582442 15423 hybrid_clock.cc:648] HybridClock initialized: now 1790192141582396 us; error 45 us; skew 500 ppm
I20260923 19:35:41.582858 15423 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:41 dist-test-slave-lzv7 krb5kdc[15317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192141, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:41.586256 15423 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:41.587976 15423 webserver.cc:460] Webserver started at http://127.12.159.193:42993/ using document root <none> and password file <none>
I20260923 19:35:41.588716 15423 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:41.588861 15423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:41.589169 15423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:41.592206 15423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "e901d5140f4e4ec699be49b3b3b2fb97"
format_stamp: "Formatted at 2026-09-23 19:35:41 on dist-test-slave-lzv7"
server_key: "6654380678a004dcf79f3538d1da56b5"
server_key_iv: "74191914c5980979755645166e65b633"
server_key_version: "encryptionkey@0"
I20260923 19:35:41.592993 15423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "e901d5140f4e4ec699be49b3b3b2fb97"
format_stamp: "Formatted at 2026-09-23 19:35:41 on dist-test-slave-lzv7"
server_key: "6654380678a004dcf79f3538d1da56b5"
server_key_iv: "74191914c5980979755645166e65b633"
server_key_version: "encryptionkey@0"
I20260923 19:35:41.598390 15423 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:35:41.601879 15438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:41.603258 15423 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:41.603433 15423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "e901d5140f4e4ec699be49b3b3b2fb97"
format_stamp: "Formatted at 2026-09-23 19:35:41 on dist-test-slave-lzv7"
server_key: "6654380678a004dcf79f3538d1da56b5"
server_key_iv: "74191914c5980979755645166e65b633"
server_key_version: "encryptionkey@0"
I20260923 19:35:41.603655 15423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:41.633791 15423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:41.638101 15423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:41.638402 15423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:41.639367 15423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:41.640730 15423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:41.640838 15423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:41.640996 15423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:41.641085 15423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:41.674474 15423 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:33963
I20260923 19:35:41.674520 15550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:33963 every 8 connection(s)
I20260923 19:35:41.675787 15423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:41.677489 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 15423
I20260923 19:35:41.677678 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:41.678373 12927 external_mini_cluster.cc:1428] Setting key 4c7e122c528a2ef6ddb51f12fbf07c9f
Sep 23 19:35:41 dist-test-slave-lzv7 krb5kdc[15317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192141, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:35:41.700131 15553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:41.679346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56969 (local address 127.12.159.254:33087)
0923 19:35:41.679819 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:41.679824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:41.680728 (+ 904us) server_negotiation.cc:407] Connection header received
0923 19:35:41.682787 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:41.682793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:41.682910 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:41.683030 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:41.685182 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:41.686172 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:41.687939 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:41.688730 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:41.688874 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:41.692779 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:41.692788 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:41.692795 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:41.692841 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:41.696813 (+ 3972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:41.697667 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:41.697675 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:41.697681 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:41.697875 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:41.698449 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:41.698454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:41.698457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:41.698739 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:41.698859 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:41.699642 (+ 783us) server_negotiation.cc:299] Negotiation successful
0923 19:35:41.699821 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":237,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
I20260923 19:35:41.701310 15554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:41.679789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33087 (local address 127.12.159.193:56969)
0923 19:35:41.680570 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:41.680616 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:41.682510 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:41.683303 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:41.683319 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:41.684175 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:41.684989 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:41.685022 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:41.686374 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:41.686378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:41.687791 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:41.687803 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:41.688997 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:41.689003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:41.689269 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:41.690010 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:41.690034 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:41.692537 (+ 2503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:41.696975 (+ 4438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:41.696983 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:41.696998 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:41.697515 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:41.698016 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:41.698020 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:41.698022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:41.698327 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:41.698909 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:41.698915 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:41.699294 (+ 379us) client_negotiation.cc:769] Sending connection context
0923 19:35:41.699544 (+ 250us) client_negotiation.cc:240] Negotiation successful
0923 19:35:41.699962 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":342,"threads_started":1}
I20260923 19:35:41.702942 15551 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33087
I20260923 19:35:41.703279 15551 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:41.704161 15551 heartbeater.cc:511] Master 127.12.159.254:33087 requested a full tablet report, sending...
I20260923 19:35:41.706668 15362 ts_manager.cc:194] Registered new tserver with Master: e901d5140f4e4ec699be49b3b3b2fb97 (127.12.159.193:33963)
I20260923 19:35:41.708551 15362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:56969
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:41.726910 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33087
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:42.059782 15557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:42.060169 15557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:42.060314 15557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:42.068910 15557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:42.069027 15557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:42.069139 15557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:42.079102 15557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:42.080348 15557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:42.081638 15557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:42.095494 15562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:42.095646 15563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:42.095654 15565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:42.097347 15557 server_base.cc:1034] running on GCE node
I20260923 19:35:42.098093 15557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:42.099049 15557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:42.100292 15557 hybrid_clock.cc:648] HybridClock initialized: now 1790192142100246 us; error 39 us; skew 500 ppm
I20260923 19:35:42.100623 15557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:42 dist-test-slave-lzv7 krb5kdc[15317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192142, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:42.103806 15557 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:42.105245 15557 webserver.cc:460] Webserver started at http://127.12.159.194:35211/ using document root <none> and password file <none>
I20260923 19:35:42.106024 15557 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:42.106166 15557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:42.106469 15557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:42.109511 15557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "3adc107536fb468b985231f455b23e29"
format_stamp: "Formatted at 2026-09-23 19:35:42 on dist-test-slave-lzv7"
server_key: "b3ec921fa6fdddbb28cd0f96901fae99"
server_key_iv: "a4de1fa577e74b20de6ac5fcc56990dd"
server_key_version: "encryptionkey@0"
I20260923 19:35:42.110359 15557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "3adc107536fb468b985231f455b23e29"
format_stamp: "Formatted at 2026-09-23 19:35:42 on dist-test-slave-lzv7"
server_key: "b3ec921fa6fdddbb28cd0f96901fae99"
server_key_iv: "a4de1fa577e74b20de6ac5fcc56990dd"
server_key_version: "encryptionkey@0"
I20260923 19:35:42.115532 15557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:42.119073 15572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:42.120398 15557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:42.120580 15557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "3adc107536fb468b985231f455b23e29"
format_stamp: "Formatted at 2026-09-23 19:35:42 on dist-test-slave-lzv7"
server_key: "b3ec921fa6fdddbb28cd0f96901fae99"
server_key_iv: "a4de1fa577e74b20de6ac5fcc56990dd"
server_key_version: "encryptionkey@0"
I20260923 19:35:42.120800 15557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:42.137578 15557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:42.141664 15557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:42.142037 15557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:42.143136 15557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:42.144502 15557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:42.144608 15557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:42.144763 15557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:42.144843 15557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:42.178999 15557 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:42465
I20260923 19:35:42.179018 15684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:42465 every 8 connection(s)
I20260923 19:35:42.180346 15557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:42.185847 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 15557
I20260923 19:35:42.186074 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:42.186512 12927 external_mini_cluster.cc:1428] Setting key 99c6b8358cd7f79102e725bcba3584b3
Sep 23 19:35:42 dist-test-slave-lzv7 krb5kdc[15317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192142, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:42.202728 15553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:42.183199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:47815 (local address 127.12.159.254:33087)
0923 19:35:42.183445 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:42.183449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:42.184824 (+ 1375us) server_negotiation.cc:407] Connection header received
0923 19:35:42.186976 (+ 2152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:42.186983 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:42.187077 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:42.187211 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:42.189180 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.190373 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.191950 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.192731 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.192866 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:42.196451 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:42.196456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:42.196459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:42.196492 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:42.199346 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:42.200108 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:42.200115 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:42.200123 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:42.200244 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:42.200751 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:42.200757 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:42.200760 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:42.201033 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:42.201210 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:42.202060 (+ 850us) server_negotiation.cc:299] Negotiation successful
0923 19:35:42.202316 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260923 19:35:42.203552 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:42.183614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33087 (local address 127.12.159.194:47815)
0923 19:35:42.184619 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:42.184671 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:42.186668 (+ 1997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:42.187518 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:42.187527 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:42.188280 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:42.188999 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:42.189016 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.190541 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.190545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:42.191796 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:42.191808 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.192928 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.192933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:42.193145 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:42.193976 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:42.193998 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:42.196222 (+ 2224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:42.199507 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:42.199517 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:42.199534 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:42.199964 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:42.200366 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:42.200373 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:42.200378 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:42.200637 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:42.201169 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:42.201179 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:42.201569 (+ 390us) client_negotiation.cc:769] Sending connection context
0923 19:35:42.201892 (+ 323us) client_negotiation.cc:240] Negotiation successful
0923 19:35:42.202376 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":464,"threads_started":1}
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:35:42.205210 15685 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33087
I20260923 19:35:42.205579 15685 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:42.206404 15685 heartbeater.cc:511] Master 127.12.159.254:33087 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
I20260923 19:35:42.208153 15362 ts_manager.cc:194] Registered new tserver with Master: 3adc107536fb468b985231f455b23e29 (127.12.159.194:42465)
I20260923 19:35:42.209450 15362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:47815
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:42.233413 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33087
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:42.567333 15690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:42.567797 15690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:42.568025 15690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:42.576661 15690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:42.576810 15690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:42.576937 15690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:42.587885 15690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:42.589372 15690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:42.590852 15690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:42.605219 15695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:42.605262 15698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:42.605309 15696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:42.606132 15690 server_base.cc:1034] running on GCE node
I20260923 19:35:42.606808 15690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:42.607918 15690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:42.609148 15690 hybrid_clock.cc:648] HybridClock initialized: now 1790192142609086 us; error 48 us; skew 500 ppm
I20260923 19:35:42.609441 15690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:42 dist-test-slave-lzv7 krb5kdc[15317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192142, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:42.612968 15690 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:42.614611 15690 webserver.cc:460] Webserver started at http://127.12.159.195:42995/ using document root <none> and password file <none>
I20260923 19:35:42.615371 15690 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:42.615515 15690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:42.615867 15690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:42.619493 15690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "7d500bdba99f4268876b870df38d4fbb"
format_stamp: "Formatted at 2026-09-23 19:35:42 on dist-test-slave-lzv7"
server_key: "4d2bb4a6b50d63c8597a5272bf239945"
server_key_iv: "3ee3d115398904e7229a64f99c0b1953"
server_key_version: "encryptionkey@0"
I20260923 19:35:42.620631 15690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "7d500bdba99f4268876b870df38d4fbb"
format_stamp: "Formatted at 2026-09-23 19:35:42 on dist-test-slave-lzv7"
server_key: "4d2bb4a6b50d63c8597a5272bf239945"
server_key_iv: "3ee3d115398904e7229a64f99c0b1953"
server_key_version: "encryptionkey@0"
I20260923 19:35:42.626717 15690 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260923 19:35:42.630393 15705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:42.631839 15690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:35:42.632022 15690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "7d500bdba99f4268876b870df38d4fbb"
format_stamp: "Formatted at 2026-09-23 19:35:42 on dist-test-slave-lzv7"
server_key: "4d2bb4a6b50d63c8597a5272bf239945"
server_key_iv: "3ee3d115398904e7229a64f99c0b1953"
server_key_version: "encryptionkey@0"
I20260923 19:35:42.632249 15690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:42.659945 15690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:42.664528 15690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:42.664846 15690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:42.665923 15690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:42.667330 15690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:42.667433 15690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:42.667577 15690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:42.667649 15690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:42.703840 15690 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:38959
I20260923 19:35:42.703900 15817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:38959 every 8 connection(s)
I20260923 19:35:42.705307 15690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:42.712364 15551 heartbeater.cc:503] Master 127.12.159.254:33087 was elected leader, sending a full tablet report...
I20260923 19:35:42.712472 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 15690
I20260923 19:35:42.712708 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:42.713464 12927 external_mini_cluster.cc:1428] Setting key 67019e8c9f2749e2735078589509b36f
Sep 23 19:35:42 dist-test-slave-lzv7 krb5kdc[15317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192142, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:42.727190 15820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:42.708080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:56437 (local address 127.12.159.254:33087)
0923 19:35:42.708560 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:42.708565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:42.709614 (+ 1049us) server_negotiation.cc:407] Connection header received
0923 19:35:42.711563 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:42.711569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:42.711665 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:42.711788 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:42.713800 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.714904 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.716997 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.717381 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.717480 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:42.721151 (+ 3671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:42.721157 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:42.721160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:42.721199 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:42.723743 (+ 2544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:42.724633 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:42.724637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:42.724639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:42.724761 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:42.725232 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:42.725236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:42.725238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:42.725625 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:42.725790 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:42.726577 (+ 787us) server_negotiation.cc:299] Negotiation successful
0923 19:35:42.726815 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":237,"threads_started":1}
I20260923 19:35:42.728356 15821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:42.708675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33087 (local address 127.12.159.195:56437)
0923 19:35:42.709409 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:42.709453 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:42.711280 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:42.712044 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:42.712052 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:42.712665 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:42.713570 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:42.713604 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.715036 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.715042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:42.716863 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:42.716876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:42.717617 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:42.717622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:42.717895 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:42.718641 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:42.718665 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:42.720939 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:42.723904 (+ 2965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:42.723912 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:42.723926 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:42.724491 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:42.724901 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:42.724905 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:42.724907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:42.725102 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:42.725795 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:42.725801 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:42.726216 (+ 415us) client_negotiation.cc:769] Sending connection context
0923 19:35:42.726460 (+ 244us) client_negotiation.cc:240] Negotiation successful
0923 19:35:42.726917 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":280,"threads_started":1}
I20260923 19:35:42.729830 15818 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33087
I20260923 19:35:42.730124 15818 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:42.730786 15818 heartbeater.cc:511] Master 127.12.159.254:33087 requested a full tablet report, sending...
I20260923 19:35:42.732164 15362 ts_manager.cc:194] Registered new tserver with Master: 7d500bdba99f4268876b870df38d4fbb (127.12.159.195:38959)
I20260923 19:35:42.733263 15362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:56437
I20260923 19:35:42.741748 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 19:35:42.774423 15820 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:35:42.771686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57394 (local address 127.12.159.254:33087)
0923 19:35:42.771915 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:42.771937 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:42.772353 (+ 416us) server_negotiation.cc:407] Connection header received
0923 19:35:42.772594 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:42.772599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:42.772700 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:42.772792 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:42.774136 (+ 1344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57394: BlockingRecv error: recv got EOF from 127.0.0.1:57394 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:35:42.777676 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15423
W20260923 19:35:42.780763 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15423: Not authorized: Client connection negotiation failed: client connection to 127.12.159.193:33963: server requires authentication, but client does not have Kerberos credentials available
I20260923 19:35:42.780999 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 15423
I20260923 19:35:42.797374 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15557
W20260923 19:35:42.800130 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15557: Not authorized: Client connection negotiation failed: client connection to 127.12.159.194:42465: server requires authentication, but client does not have Kerberos credentials available
I20260923 19:35:42.800307 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 15557
I20260923 19:35:42.815469 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15690
W20260923 19:35:42.818524 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15690: Not authorized: Client connection negotiation failed: client connection to 127.12.159.195:38959: server requires authentication, but client does not have Kerberos credentials available
I20260923 19:35:42.818653 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 15690
I20260923 19:35:42.833747 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15330
I20260923 19:35:42.835250 15392 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:42.939917 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 15330
2026-09-23T19:35:42Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3727 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:43 dist-test-slave-lzv7 krb5kdc[15836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:43 dist-test-slave-lzv7 krb5kdc[15836](info): set up 2 sockets
Sep 23 19:35:43 dist-test-slave-lzv7 krb5kdc[15836](info): commencing operation
krb5kdc: starting...
W20260923 19:35:44.038404 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.005s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:44 dist-test-slave-lzv7 krb5kdc[15836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:44.237365 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38151
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:38151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:44.576217 15849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:44.576524 15849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:44.576714 15849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:44.584237 15849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:44.584359 15849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:44.584453 15849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:44.584529 15849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:44.584596 15849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:44.595148 15849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:38151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:44.596516 15849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:44.597908 15849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:44.610074 15855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:44.609979 15857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:44.610232 15854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:44.611263 15849 server_base.cc:1034] running on GCE node
I20260923 19:35:44.612164 15849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:44.613626 15849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:44.614883 15849 hybrid_clock.cc:648] HybridClock initialized: now 1790192144614839 us; error 60 us; skew 500 ppm
I20260923 19:35:44.615315 15849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:44 dist-test-slave-lzv7 krb5kdc[15836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192144, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:44.618587 15849 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:44.620119 15849 webserver.cc:460] Webserver started at http://127.12.159.254:40971/ using document root <none> and password file <none>
I20260923 19:35:44.620839 15849 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:44.620985 15849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:44.621312 15849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:44.624415 15849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "e094acdc04354e5a8cd7200c5917b6be"
format_stamp: "Formatted at 2026-09-23 19:35:44 on dist-test-slave-lzv7"
server_key: "5b4c4b7f3649e360874fb0cb3a333c00"
server_key_iv: "ae31f1256e1f50a8da17d20904c4d91e"
server_key_version: "encryptionkey@0"
I20260923 19:35:44.625200 15849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "e094acdc04354e5a8cd7200c5917b6be"
format_stamp: "Formatted at 2026-09-23 19:35:44 on dist-test-slave-lzv7"
server_key: "5b4c4b7f3649e360874fb0cb3a333c00"
server_key_iv: "ae31f1256e1f50a8da17d20904c4d91e"
server_key_version: "encryptionkey@0"
I20260923 19:35:44.631753 15849 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.004s
I20260923 19:35:44.635200 15864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:44.636665 15849 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:44.636884 15849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "e094acdc04354e5a8cd7200c5917b6be"
format_stamp: "Formatted at 2026-09-23 19:35:44 on dist-test-slave-lzv7"
server_key: "5b4c4b7f3649e360874fb0cb3a333c00"
server_key_iv: "ae31f1256e1f50a8da17d20904c4d91e"
server_key_version: "encryptionkey@0"
I20260923 19:35:44.637111 15849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:44.651870 15849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:44.656611 15849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:44.656945 15849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:44.677589 15849 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:38151
I20260923 19:35:44.677608 15915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:38151 every 8 connection(s)
I20260923 19:35:44.679100 15849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:44.682909 15916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:44.686437 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 15849
I20260923 19:35:44.686697 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:44.687502 12927 external_mini_cluster.cc:1428] Setting key 716661551c63c94aad659ae11019162a
I20260923 19:35:44.696358 15916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be: Bootstrap starting.
I20260923 19:35:44.700213 15916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:44.701556 15916 log.cc:824] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:35:44 dist-test-slave-lzv7 krb5kdc[15836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:44.704614 15916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be: No bootstrap required, opened a new log
I20260923 19:35:44.711229 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:44.689592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43480 (local address 127.12.159.254:38151)
0923 19:35:44.690508 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:44.690519 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:44.690560 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:35:44.692161 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:44.692183 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:44.692614 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:44.692954 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:44.694836 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:44.696155 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:44.697952 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:44.698675 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:44.698834 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:44.703835 (+ 5001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:44.703843 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:44.703858 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:44.703895 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:44.706981 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:44.707708 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:44.707722 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:44.707729 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:44.707895 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:44.708293 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:44.708300 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:44.708303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:44.708891 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:44.709230 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:44.709685 (+ 455us) server_negotiation.cc:299] Negotiation successful
0923 19:35:44.710190 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":498,"threads_started":1}
I20260923 19:35:44.712565 15916 raft_consensus.cc:348] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e094acdc04354e5a8cd7200c5917b6be" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38151 } }
I20260923 19:35:44.713044 15916 raft_consensus.cc:374] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:44.713155 15916 raft_consensus.cc:729] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e094acdc04354e5a8cd7200c5917b6be, State: Initialized, Role: FOLLOWER
I20260923 19:35:44.713858 15916 consensus_queue.cc:260] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e094acdc04354e5a8cd7200c5917b6be" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38151 } }
I20260923 19:35:44.714128 15916 raft_consensus.cc:388] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:44.714268 15916 raft_consensus.cc:482] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:44.714449 15916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:44.715502 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:35:44.717607 15916 raft_consensus.cc:504] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e094acdc04354e5a8cd7200c5917b6be" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38151 } }
I20260923 19:35:44.718230 15916 leader_election.cc:302] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e094acdc04354e5a8cd7200c5917b6be; no voters:
I20260923 19:35:44.718899 15916 leader_election.cc:288] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:44.719013 15921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:44.721159 15916 sys_catalog.cc:564] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:44.722121 15921 raft_consensus.cc:686] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [term 1 LEADER]: Becoming Leader. State: Replica: e094acdc04354e5a8cd7200c5917b6be, State: Running, Role: LEADER
I20260923 19:35:44.722731 15921 consensus_queue.cc:237] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e094acdc04354e5a8cd7200c5917b6be" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38151 } }
I20260923 19:35:44.725747 15922 sys_catalog.cc:455] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e094acdc04354e5a8cd7200c5917b6be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e094acdc04354e5a8cd7200c5917b6be" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38151 } } }
I20260923 19:35:44.726204 15922 sys_catalog.cc:458] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:44.725728 15923 sys_catalog.cc:455] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [sys.catalog]: SysCatalogTable state changed. Reason: New leader e094acdc04354e5a8cd7200c5917b6be. Latest consensus state: current_term: 1 leader_uuid: "e094acdc04354e5a8cd7200c5917b6be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e094acdc04354e5a8cd7200c5917b6be" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38151 } } }
I20260923 19:35:44.726763 15923 sys_catalog.cc:458] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:44.740056 15930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:44.746212 15930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:44.758109 15930 catalog_manager.cc:1347] Generated new cluster ID: 8793ce48207b4db3b4f02dae084f8d6a
I20260923 19:35:44.758337 15930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:44.773236 15930 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:44.775146 15930 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:44.788581 15944 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:35:44.798348 15930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e094acdc04354e5a8cd7200c5917b6be: Generated new TSK 0
I20260923 19:35:44.798866 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:44.790945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43494 (local address 127.12.159.254:38151)
0923 19:35:44.791152 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:44.791162 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:44.791745 (+ 583us) server_negotiation.cc:407] Connection header received
0923 19:35:44.791968 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:44.791974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:44.792060 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:44.792175 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:44.793203 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:44.794092 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:44.795380 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:44.795838 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:44.795979 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:44.797123 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:44.797135 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:44.797140 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:44.797979 (+ 839us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:44.798067 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:44.798102 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:44.798206 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:44.798405 (+ 199us) server_negotiation.cc:299] Negotiation successful
0923 19:35:44.798506 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:35:44.799402 15930 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:35:44.810992 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15849
I20260923 19:35:44.812170 15911 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:44.905624 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 15849
2026-09-23T19:35:44Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1959 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:44 dist-test-slave-lzv7 krb5kdc[15950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:44 dist-test-slave-lzv7 krb5kdc[15950](info): set up 2 sockets
Sep 23 19:35:44 dist-test-slave-lzv7 krb5kdc[15950](info): commencing operation
krb5kdc: starting...
W20260923 19:35:46.006217 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:46 dist-test-slave-lzv7 krb5kdc[15950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:46.202149 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34765
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:34765
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:46.528584 15963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:46.529078 15963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:46.529258 15963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:46.537276 15963 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:46.537392 15963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:46.537473 15963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:46.537562 15963 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:46.537647 15963 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:46.547904 15963 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:34765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:46.549279 15963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:46.550704 15963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:46.562748 15971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:46.562841 15969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:46.563073 15968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:46.563786 15963 server_base.cc:1034] running on GCE node
I20260923 19:35:46.564618 15963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:46.566113 15963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:46.567333 15963 hybrid_clock.cc:648] HybridClock initialized: now 1790192146567245 us; error 66 us; skew 500 ppm
I20260923 19:35:46.567683 15963 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:46 dist-test-slave-lzv7 krb5kdc[15950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192146, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:46.577746 15963 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:46.579528 15963 webserver.cc:460] Webserver started at http://127.12.159.254:36355/ using document root <none> and password file <none>
I20260923 19:35:46.580228 15963 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:46.580384 15963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:46.580708 15963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:46.583737 15963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "758f019682594b759e834dccf9ab9b90"
format_stamp: "Formatted at 2026-09-23 19:35:46 on dist-test-slave-lzv7"
server_key: "df4dde38742de131d5d0eef7b1bbe6d2"
server_key_iv: "4513709573b0bd94bd8c5328ca10ac2a"
server_key_version: "encryptionkey@0"
I20260923 19:35:46.584527 15963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "758f019682594b759e834dccf9ab9b90"
format_stamp: "Formatted at 2026-09-23 19:35:46 on dist-test-slave-lzv7"
server_key: "df4dde38742de131d5d0eef7b1bbe6d2"
server_key_iv: "4513709573b0bd94bd8c5328ca10ac2a"
server_key_version: "encryptionkey@0"
I20260923 19:35:46.590138 15963 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:35:46.593735 15978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:46.595502 15963 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:35:46.595718 15963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "758f019682594b759e834dccf9ab9b90"
format_stamp: "Formatted at 2026-09-23 19:35:46 on dist-test-slave-lzv7"
server_key: "df4dde38742de131d5d0eef7b1bbe6d2"
server_key_iv: "4513709573b0bd94bd8c5328ca10ac2a"
server_key_version: "encryptionkey@0"
I20260923 19:35:46.595932 15963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:46.618997 15963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:46.623903 15963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:46.624245 15963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:46.645664 15963 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:34765
I20260923 19:35:46.645686 16029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:34765 every 8 connection(s)
I20260923 19:35:46.647228 15963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:46.651108 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 15963
I20260923 19:35:46.651335 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:46.651492 16030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:46.652211 12927 external_mini_cluster.cc:1428] Setting key f567f4125e07cb1bfffac4dd9b91ccf8
I20260923 19:35:46.665990 16030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90: Bootstrap starting.
Sep 23 19:35:46 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:46.669924 16030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:46.671020 16030 log.cc:824] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:46.674036 16030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90: No bootstrap required, opened a new log
I20260923 19:35:46.676981 16033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:46.654415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59326 (local address 127.12.159.254:34765)
0923 19:35:46.655315 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:46.655326 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:46.655370 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:35:46.657788 (+ 2418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:46.657871 (+ 83us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:46.658329 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:46.658709 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:46.660439 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:46.661787 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:46.663744 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:46.664485 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:46.664643 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:46.669511 (+ 4868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:46.669519 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:46.669536 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:46.669582 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:46.672792 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:46.673522 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:46.673533 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:46.673547 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:46.673727 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:46.674203 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:46.674207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:46.674209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:46.674730 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:46.675059 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:46.675492 (+ 433us) server_negotiation.cc:299] Negotiation successful
0923 19:35:46.675930 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":437,"threads_started":1}
I20260923 19:35:46.682386 16030 raft_consensus.cc:348] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758f019682594b759e834dccf9ab9b90" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34765 } }
I20260923 19:35:46.682778 16030 raft_consensus.cc:374] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:46.682905 16030 raft_consensus.cc:729] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 758f019682594b759e834dccf9ab9b90, State: Initialized, Role: FOLLOWER
I20260923 19:35:46.683564 16030 consensus_queue.cc:260] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758f019682594b759e834dccf9ab9b90" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34765 } }
I20260923 19:35:46.683800 16030 raft_consensus.cc:388] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:46.683938 16030 raft_consensus.cc:482] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:46.684119 16030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:46.686412 16030 raft_consensus.cc:504] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758f019682594b759e834dccf9ab9b90" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34765 } }
I20260923 19:35:46.686928 16030 leader_election.cc:302] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 758f019682594b759e834dccf9ab9b90; no voters:
I20260923 19:35:46.687675 16030 leader_election.cc:288] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:46.687834 16035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:46.688547 16035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [term 1 LEADER]: Becoming Leader. State: Replica: 758f019682594b759e834dccf9ab9b90, State: Running, Role: LEADER
I20260923 19:35:46.689138 16035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758f019682594b759e834dccf9ab9b90" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34765 } }
I20260923 19:35:46.689980 16030 sys_catalog.cc:564] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:46.691862 16036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "758f019682594b759e834dccf9ab9b90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758f019682594b759e834dccf9ab9b90" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34765 } } }
I20260923 19:35:46.692286 16036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:46.692477 16037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 758f019682594b759e834dccf9ab9b90. Latest consensus state: current_term: 1 leader_uuid: "758f019682594b759e834dccf9ab9b90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758f019682594b759e834dccf9ab9b90" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34765 } } }
I20260923 19:35:46.692817 16037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:46.695127 16040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:46.700235 16040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:46.709681 16040 catalog_manager.cc:1347] Generated new cluster ID: 74fc29c1045e494095e6c83b1cbfeee5
I20260923 19:35:46.709848 16040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:46.718935 16040 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:46.720377 16040 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:46.729184 16040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 758f019682594b759e834dccf9ab9b90: Generated new TSK 0
I20260923 19:35:46.730147 16040 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:46.782527 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34765
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:47.117785 16056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:47.118083 16056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:47.118189 16056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:47.125419 16056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:47.125531 16056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:47.125643 16056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:47.135607 16056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:47.136854 16056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:47.138167 16056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:47.151750 16064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:47.151780 16061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:47.151698 16062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:47.152866 16056 server_base.cc:1034] running on GCE node
I20260923 19:35:47.153544 16056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:47.154577 16056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:47.155853 16056 hybrid_clock.cc:648] HybridClock initialized: now 1790192147155808 us; error 52 us; skew 500 ppm
I20260923 19:35:47.156208 16056 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:47 dist-test-slave-lzv7 krb5kdc[15950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192147, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:47.159794 16056 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:47.161330 16056 webserver.cc:460] Webserver started at http://127.12.159.193:35303/ using document root <none> and password file <none>
I20260923 19:35:47.162109 16056 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:47.162256 16056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:47.162557 16056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:47.165544 16056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "67adf9f420044ab28d4c1fa49690538b"
format_stamp: "Formatted at 2026-09-23 19:35:47 on dist-test-slave-lzv7"
server_key: "ca76775dbabe95e90168a989db7290bc"
server_key_iv: "824803577a223360ca10e1337c860c8d"
server_key_version: "encryptionkey@0"
I20260923 19:35:47.166407 16056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "67adf9f420044ab28d4c1fa49690538b"
format_stamp: "Formatted at 2026-09-23 19:35:47 on dist-test-slave-lzv7"
server_key: "ca76775dbabe95e90168a989db7290bc"
server_key_iv: "824803577a223360ca10e1337c860c8d"
server_key_version: "encryptionkey@0"
I20260923 19:35:47.171749 16056 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:35:47.175371 16071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:47.177109 16056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:35:47.177307 16056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "67adf9f420044ab28d4c1fa49690538b"
format_stamp: "Formatted at 2026-09-23 19:35:47 on dist-test-slave-lzv7"
server_key: "ca76775dbabe95e90168a989db7290bc"
server_key_iv: "824803577a223360ca10e1337c860c8d"
server_key_version: "encryptionkey@0"
I20260923 19:35:47.177538 16056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:47.219866 16056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:47.224367 16056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:47.224704 16056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:47.225711 16056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:47.227152 16056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:47.227255 16056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:47.227406 16056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:47.227478 16056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:47.261293 16056 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:46603
I20260923 19:35:47.261395 16183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:46603 every 8 connection(s)
I20260923 19:35:47.262717 16056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:47.272876 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 16056
I20260923 19:35:47.273097 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:47.273752 12927 external_mini_cluster.cc:1428] Setting key e05c5d779094bfc32b4283a3f158ba96
Sep 23 19:35:47 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192147, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:47.285481 16186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:47.265373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:49299 (local address 127.12.159.254:34765)
0923 19:35:47.265901 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:47.265906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:47.266924 (+ 1018us) server_negotiation.cc:407] Connection header received
0923 19:35:47.268744 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:47.268749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:47.268846 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:47.268966 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:47.270534 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.271281 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.273248 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.273725 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.273917 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:47.278215 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:47.278223 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:47.278231 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:47.278286 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:47.281943 (+ 3657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:47.283036 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:47.283041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:47.283043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:47.283171 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:47.283691 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:47.283694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:47.283696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:47.283963 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:47.284073 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:47.285043 (+ 970us) server_negotiation.cc:299] Negotiation successful
0923 19:35:47.285219 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":235,"threads_started":1}
I20260923 19:35:47.287151 16187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:47.266076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34765 (local address 127.12.159.193:49299)
0923 19:35:47.266749 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:47.266787 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:47.268458 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:47.269208 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:47.269217 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:47.269735 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:47.270357 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:47.270374 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.271455 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.271465 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:47.273081 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:47.273099 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.274019 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.274026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:47.274319 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:47.275177 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:47.275203 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:47.277985 (+ 2782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:47.282096 (+ 4111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:47.282107 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:47.282127 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:47.282865 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:47.283293 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:47.283300 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:47.283307 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:47.283577 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:47.284093 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:47.284104 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:47.284613 (+ 509us) client_negotiation.cc:769] Sending connection context
0923 19:35:47.284933 (+ 320us) client_negotiation.cc:240] Negotiation successful
0923 19:35:47.285555 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":250,"threads_started":1}
I20260923 19:35:47.288934 16184 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34765
I20260923 19:35:47.289269 16184 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:47.290233 16184 heartbeater.cc:511] Master 127.12.159.254:34765 requested a full tablet report, sending...
I20260923 19:35:47.292524 15995 ts_manager.cc:194] Registered new tserver with Master: 67adf9f420044ab28d4c1fa49690538b (127.12.159.193:46603)
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:35:47.294133 15995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:49299
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:47.321511 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34765
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:47.665927 16190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:47.666249 16190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:47.666360 16190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:47.673872 16190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:47.674010 16190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:47.674129 16190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:47.684867 16190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:47.686300 16190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:47.687633 16190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:47.700947 16195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:47.700973 16196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:47.701470 16198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:47.701783 16190 server_base.cc:1034] running on GCE node
I20260923 19:35:47.702461 16190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:47.703455 16190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:47.704712 16190 hybrid_clock.cc:648] HybridClock initialized: now 1790192147704642 us; error 57 us; skew 500 ppm
I20260923 19:35:47.705046 16190 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:47 dist-test-slave-lzv7 krb5kdc[15950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192147, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:47.708245 16190 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:47.709800 16190 webserver.cc:460] Webserver started at http://127.12.159.194:41049/ using document root <none> and password file <none>
I20260923 19:35:47.710595 16190 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:47.710727 16190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:47.711064 16190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:47.714008 16190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "c7fd9989e8624d5dbce5c59ba2ce5312"
format_stamp: "Formatted at 2026-09-23 19:35:47 on dist-test-slave-lzv7"
server_key: "494372fbb39b7fb40813989c42e6cca2"
server_key_iv: "8926fc0d8f93eadf89b2264cd6cbc76d"
server_key_version: "encryptionkey@0"
I20260923 19:35:47.714843 16190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "c7fd9989e8624d5dbce5c59ba2ce5312"
format_stamp: "Formatted at 2026-09-23 19:35:47 on dist-test-slave-lzv7"
server_key: "494372fbb39b7fb40813989c42e6cca2"
server_key_iv: "8926fc0d8f93eadf89b2264cd6cbc76d"
server_key_version: "encryptionkey@0"
I20260923 19:35:47.720253 16190 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:47.723944 16205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:47.725344 16190 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:47.725538 16190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "c7fd9989e8624d5dbce5c59ba2ce5312"
format_stamp: "Formatted at 2026-09-23 19:35:47 on dist-test-slave-lzv7"
server_key: "494372fbb39b7fb40813989c42e6cca2"
server_key_iv: "8926fc0d8f93eadf89b2264cd6cbc76d"
server_key_version: "encryptionkey@0"
I20260923 19:35:47.725755 16190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:47.743067 16190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:47.747375 16190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:47.747709 16190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:47.748687 16190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:47.750255 16190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:47.750358 16190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:47.750515 16190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:47.750597 16190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:47.784058 16190 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:40027
I20260923 19:35:47.784097 16317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:40027 every 8 connection(s)
I20260923 19:35:47.785480 16190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:47.792096 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 16190
I20260923 19:35:47.792296 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:47.792981 12927 external_mini_cluster.cc:1428] Setting key 636958d199b1559e2239b2b668cce688
Sep 23 19:35:47 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192147, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:47.809602 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:47.788382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:45691 (local address 127.12.159.254:34765)
0923 19:35:47.788830 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:47.788835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:47.789959 (+ 1124us) server_negotiation.cc:407] Connection header received
0923 19:35:47.792026 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:47.792032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:47.792131 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:47.792272 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:47.794355 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.795104 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.796734 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.797280 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.797434 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:47.801745 (+ 4311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:47.801755 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:47.801764 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:47.801834 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:47.805690 (+ 3856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:47.806586 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:47.806594 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:47.806601 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:47.806763 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:47.807191 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:47.807199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:47.807205 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:47.807624 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:47.807785 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:47.808794 (+ 1009us) server_negotiation.cc:299] Negotiation successful
0923 19:35:47.809067 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":228,"threads_started":1}
I20260923 19:35:47.810457 16321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:47.788859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34765 (local address 127.12.159.194:45691)
0923 19:35:47.789741 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:47.789788 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:47.791718 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:47.792649 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:47.792666 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:47.793449 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:47.794176 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:47.794194 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.795274 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.795278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:47.796582 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:47.796599 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:47.797525 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:47.797532 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:47.797770 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:47.798555 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:47.798579 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:47.801465 (+ 2886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:47.805934 (+ 4469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:47.805943 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:47.805961 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:47.806426 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:47.806874 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:47.806878 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:47.806880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:47.807064 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:47.807785 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:47.807792 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:47.808340 (+ 548us) client_negotiation.cc:769] Sending connection context
0923 19:35:47.808630 (+ 290us) client_negotiation.cc:240] Negotiation successful
0923 19:35:47.809072 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":321,"threads_started":1}
I20260923 19:35:47.812129 16318 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34765
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:35:47.812506 16318 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:47.813328 16318 heartbeater.cc:511] Master 127.12.159.254:34765 requested a full tablet report, sending...
I20260923 19:35:47.815075 15995 ts_manager.cc:194] Registered new tserver with Master: c7fd9989e8624d5dbce5c59ba2ce5312 (127.12.159.194:40027)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
I20260923 19:35:47.816239 15995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:45691
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:47.842741 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34765
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:48.172564 16324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:48.172920 16324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:48.173087 16324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:48.180506 16324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:48.180691 16324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:48.180925 16324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:48.191327 16324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:48.192783 16324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:48.194139 16324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:48.208295 16329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:48.208360 16332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:48.208326 16330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:48.209048 16324 server_base.cc:1034] running on GCE node
I20260923 19:35:48.209942 16324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:48.210996 16324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:48.212226 16324 hybrid_clock.cc:648] HybridClock initialized: now 1790192148212184 us; error 41 us; skew 500 ppm
I20260923 19:35:48.212574 16324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[15950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192148, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:48.215930 16324 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:48.217391 16324 webserver.cc:460] Webserver started at http://127.12.159.195:36937/ using document root <none> and password file <none>
I20260923 19:35:48.218180 16324 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:48.218312 16324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:48.218631 16324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:48.221599 16324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "5eb6cc9454854dadb4cef1cc19c2cbc6"
format_stamp: "Formatted at 2026-09-23 19:35:48 on dist-test-slave-lzv7"
server_key: "1b97497d20f683821acf97ae83303fee"
server_key_iv: "6e91c180240f7a23c7ec913958ff13c9"
server_key_version: "encryptionkey@0"
I20260923 19:35:48.222476 16324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "5eb6cc9454854dadb4cef1cc19c2cbc6"
format_stamp: "Formatted at 2026-09-23 19:35:48 on dist-test-slave-lzv7"
server_key: "1b97497d20f683821acf97ae83303fee"
server_key_iv: "6e91c180240f7a23c7ec913958ff13c9"
server_key_version: "encryptionkey@0"
I20260923 19:35:48.227766 16324 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:48.231302 16339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:48.232669 16324 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260923 19:35:48.232842 16324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "5eb6cc9454854dadb4cef1cc19c2cbc6"
format_stamp: "Formatted at 2026-09-23 19:35:48 on dist-test-slave-lzv7"
server_key: "1b97497d20f683821acf97ae83303fee"
server_key_iv: "6e91c180240f7a23c7ec913958ff13c9"
server_key_version: "encryptionkey@0"
I20260923 19:35:48.233023 16324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:48.247885 16324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:48.252162 16324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:48.252496 16324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:48.253520 16324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:48.254866 16324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:48.254941 16324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:48.255066 16324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:48.255127 16324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:48.290416 16324 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:45263
I20260923 19:35:48.290448 16451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:45263 every 8 connection(s)
I20260923 19:35:48.291941 16324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:48.292472 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 16324
I20260923 19:35:48.292733 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:48.293319 12927 external_mini_cluster.cc:1428] Setting key 31bd63570adca9a830e5bd84a91a15c4
I20260923 19:35:48.297305 16184 heartbeater.cc:503] Master 127.12.159.254:34765 was elected leader, sending a full tablet report...
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192148, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:48.313432 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:48.294904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:51741 (local address 127.12.159.254:34765)
0923 19:35:48.295092 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:48.295099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:48.296557 (+ 1458us) server_negotiation.cc:407] Connection header received
0923 19:35:48.298907 (+ 2350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:48.298912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:48.298991 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:48.299112 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:48.300739 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.301579 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.303270 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.303666 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.303802 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:48.307371 (+ 3569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:48.307378 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:48.307382 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:48.307426 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:48.310630 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.311307 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.311310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.311313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.311420 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.311830 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.311833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.311835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.312091 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:48.312231 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:48.312977 (+ 746us) server_negotiation.cc:299] Negotiation successful
0923 19:35:48.313170 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:35:48.314448 16454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:48.295589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34765 (local address 127.12.159.195:51741)
0923 19:35:48.296407 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:48.296457 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:48.298619 (+ 2162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:48.299351 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:48.299359 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:48.299991 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:48.300559 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:48.300576 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.301747 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.301751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:48.303122 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:48.303134 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.303888 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.303896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:48.304125 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:48.304800 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:48.304822 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:48.307101 (+ 2279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:48.310777 (+ 3676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:48.310784 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:48.310797 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:48.311204 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:48.311512 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:48.311516 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:48.311518 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:48.311728 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:48.312225 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:48.312231 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:48.312550 (+ 319us) client_negotiation.cc:769] Sending connection context
0923 19:35:48.312791 (+ 241us) client_negotiation.cc:240] Negotiation successful
0923 19:35:48.313187 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":309,"threads_started":1}
I20260923 19:35:48.315927 16452 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34765
I20260923 19:35:48.316248 16452 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:48.316999 16452 heartbeater.cc:511] Master 127.12.159.254:34765 requested a full tablet report, sending...
I20260923 19:35:48.318485 15995 ts_manager.cc:194] Registered new tserver with Master: 5eb6cc9454854dadb4cef1cc19c2cbc6 (127.12.159.195:45263)
I20260923 19:35:48.319288 15995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:51741
I20260923 19:35:48.321678 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[15950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192148, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192148, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:48.370445 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:48.355924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34736 (local address 127.12.159.254:34765)
0923 19:35:48.356096 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:48.356106 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:48.356622 (+ 516us) server_negotiation.cc:407] Connection header received
0923 19:35:48.356780 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:48.356784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:48.356860 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:48.356960 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:48.358362 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.359084 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.360332 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.360760 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.360927 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:48.364928 (+ 4001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:48.364933 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:48.364937 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:48.364970 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:48.367659 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.368325 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.368331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.368335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.368469 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.368869 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.368874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.368878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.369230 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:48.369499 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:48.369838 (+ 339us) server_negotiation.cc:299] Negotiation successful
0923 19:35:48.370072 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260923 19:35:48.371055 15995 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34736
I20260923 19:35:48.372735 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16056
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192148, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:48.388289 16463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:48.373840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46888 (local address 127.12.159.193:46603)
0923 19:35:48.374433 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:48.374440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:48.374465 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:35:48.374519 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:48.374526 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:48.374733 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:48.374891 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:48.376047 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.377055 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.378303 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.378844 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.378940 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:48.383039 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:48.383050 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:48.383064 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:48.383098 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:48.386040 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.386692 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.386699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.386701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.386816 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.387125 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.387128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.387130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.387440 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:48.387712 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:48.387840 (+ 128us) server_negotiation.cc:299] Negotiation successful
0923 19:35:48.388022 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":303,"threads_started":1}
W20260923 19:35:48.389547 16179 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46888
W20260923 19:35:48.390828 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16056: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:48.391090 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 16056
I20260923 19:35:48.407823 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16190
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192148, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:35:48.425098 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:48.408847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56994 (local address 127.12.159.194:40027)
0923 19:35:48.409456 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:48.409464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:48.409493 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:35:48.409563 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:48.409570 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:48.409780 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:48.409982 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:48.411359 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.412434 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.413872 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.414442 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.414541 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:48.418941 (+ 4400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:48.418954 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:48.418971 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:48.419008 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:48.422261 (+ 3253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.422949 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.422956 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.422958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.423097 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.423537 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.423540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.423542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.423897 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:48.424142 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:48.424557 (+ 415us) server_negotiation.cc:299] Negotiation successful
0923 19:35:48.424788 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":330,"threads_started":1}
W20260923 19:35:48.426486 16313 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56994
W20260923 19:35:48.427599 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16190: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:48.427769 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 16190
I20260923 19:35:48.443373 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16324
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[15950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192148, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:35:48.460881 16465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:48.444536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46212 (local address 127.12.159.195:45263)
0923 19:35:48.445392 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:48.445399 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:48.445433 (+ 34us) server_negotiation.cc:407] Connection header received
0923 19:35:48.445496 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:48.445503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:48.445749 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:48.445957 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:48.447234 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.448360 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.449574 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:48.450259 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:48.450386 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:48.454828 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:48.454843 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:48.454876 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:48.454929 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:48.458202 (+ 3273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.458850 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.458857 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.458859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.458973 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:48.459281 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:48.459284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:48.459286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:48.459607 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:48.459840 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:48.460278 (+ 438us) server_negotiation.cc:299] Negotiation successful
0923 19:35:48.460498 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":478,"threads_started":1}
W20260923 19:35:48.462467 16447 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46212
W20260923 19:35:48.463804 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16324: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:35:48.463974 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 16324
I20260923 19:35:48.480628 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 15963
I20260923 19:35:48.482019 16025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:48.589453 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 15963
2026-09-23T19:35:48Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3689 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[16469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[16469](info): set up 2 sockets
Sep 23 19:35:48 dist-test-slave-lzv7 krb5kdc[16469](info): commencing operation
krb5kdc: starting...
W20260923 19:35:49.686365 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.007s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:49 dist-test-slave-lzv7 krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:49.894989 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45855
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:50.218654 16482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:50.219015 16482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:50.219184 16482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:50.226559 16482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:50.226701 16482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:50.226818 16482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:50.226912 16482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:50.226996 16482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:50.237018 16482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:50.238413 16482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:50.239730 16482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:50.251529 16487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:50.251474 16488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:50.251577 16490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:50.252470 16482 server_base.cc:1034] running on GCE node
I20260923 19:35:50.253209 16482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:50.254678 16482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:50.255889 16482 hybrid_clock.cc:648] HybridClock initialized: now 1790192150255844 us; error 31 us; skew 500 ppm
I20260923 19:35:50.256249 16482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:50 dist-test-slave-lzv7 krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192150, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:50.259366 16482 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:50.260880 16482 webserver.cc:460] Webserver started at http://127.12.159.254:37987/ using document root <none> and password file <none>
I20260923 19:35:50.261600 16482 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:50.261758 16482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:50.262095 16482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:50.265134 16482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "ed390dc76e1e49bbb33b4e8009c6534e"
format_stamp: "Formatted at 2026-09-23 19:35:50 on dist-test-slave-lzv7"
server_key: "ccb48d23f4658d7e75c57709dc07faae"
server_key_iv: "b3a44661adfd5570a3236876c2cf8ca1"
server_key_version: "encryptionkey@0"
I20260923 19:35:50.265982 16482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "ed390dc76e1e49bbb33b4e8009c6534e"
format_stamp: "Formatted at 2026-09-23 19:35:50 on dist-test-slave-lzv7"
server_key: "ccb48d23f4658d7e75c57709dc07faae"
server_key_iv: "b3a44661adfd5570a3236876c2cf8ca1"
server_key_version: "encryptionkey@0"
I20260923 19:35:50.271083 16482 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:35:50.274549 16497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:50.275825 16482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:50.276010 16482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "ed390dc76e1e49bbb33b4e8009c6534e"
format_stamp: "Formatted at 2026-09-23 19:35:50 on dist-test-slave-lzv7"
server_key: "ccb48d23f4658d7e75c57709dc07faae"
server_key_iv: "b3a44661adfd5570a3236876c2cf8ca1"
server_key_version: "encryptionkey@0"
I20260923 19:35:50.276206 16482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:50.298038 16482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:50.302191 16482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:50.302811 16482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:50.322190 16482 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45855
I20260923 19:35:50.322211 16548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45855 every 8 connection(s)
I20260923 19:35:50.323580 16482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:50.324055 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 16482
I20260923 19:35:50.324335 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:50.325131 12927 external_mini_cluster.cc:1428] Setting key e69ea709de4fa7545fef5d23f62dd084
I20260923 19:35:50.328013 16549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:35:50 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:50.341780 16549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e: Bootstrap starting.
I20260923 19:35:50.345089 16549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:50.346246 16549 log.cc:824] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:50.349584 16552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:50.327304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42742 (local address 127.12.159.254:45855)
0923 19:35:50.328196 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:50.328208 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:50.328251 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:35:50.329957 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:50.329979 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:50.330373 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:50.330755 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:50.332665 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:50.334201 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:50.335990 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:50.336689 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:50.336847 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:50.341893 (+ 5046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:50.341913 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:50.341930 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:50.342002 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:50.345081 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:50.345843 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:50.345857 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:50.345864 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:50.346046 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:50.346505 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:50.346508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:50.346510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:50.347299 (+ 789us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:50.347633 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:50.348085 (+ 452us) server_negotiation.cc:299] Negotiation successful
0923 19:35:50.348541 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":386,"threads_started":1}
I20260923 19:35:50.349681 16549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e: No bootstrap required, opened a new log
I20260923 19:35:50.358072 16549 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45855 } }
I20260923 19:35:50.358508 16549 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:50.358628 16549 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed390dc76e1e49bbb33b4e8009c6534e, State: Initialized, Role: FOLLOWER
I20260923 19:35:50.359305 16549 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45855 } }
I20260923 19:35:50.359551 16549 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:50.359746 16549 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:50.359923 16549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:50.362257 16549 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45855 } }
I20260923 19:35:50.362789 16549 leader_election.cc:302] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed390dc76e1e49bbb33b4e8009c6534e; no voters:
I20260923 19:35:50.363476 16549 leader_election.cc:288] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:50.363637 16554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:50.364454 16554 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [term 1 LEADER]: Becoming Leader. State: Replica: ed390dc76e1e49bbb33b4e8009c6534e, State: Running, Role: LEADER
I20260923 19:35:50.365090 16554 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45855 } }
I20260923 19:35:50.365680 16549 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:50.368068 16555 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45855 } } }
I20260923 19:35:50.368384 16555 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:50.368854 16556 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed390dc76e1e49bbb33b4e8009c6534e. Latest consensus state: current_term: 1 leader_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed390dc76e1e49bbb33b4e8009c6534e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45855 } } }
I20260923 19:35:50.369181 16556 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:50.369302 16562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:50.375850 16562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:50.384511 16562 catalog_manager.cc:1347] Generated new cluster ID: f87435a15a5441cf97e2823f9be46e8a
I20260923 19:35:50.384629 16562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:50.397219 16562 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:50.398849 16562 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:50.408775 16562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed390dc76e1e49bbb33b4e8009c6534e: Generated new TSK 0
I20260923 19:35:50.410037 16562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:50.470429 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45855
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:50.811992 16575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:50.812274 16575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:50.812439 16575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:50.820092 16575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:50.820210 16575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:50.820411 16575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:50.830574 16575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:50.832043 16575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:50.833384 16575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:50.847178 16581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:50.847678 16580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:50.847810 16583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:50.848918 16575 server_base.cc:1034] running on GCE node
I20260923 19:35:50.849568 16575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:50.850632 16575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:50.851841 16575 hybrid_clock.cc:648] HybridClock initialized: now 1790192150851794 us; error 37 us; skew 500 ppm
I20260923 19:35:50.852188 16575 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:50 dist-test-slave-lzv7 krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192150, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:50.855645 16575 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:50.857242 16575 webserver.cc:460] Webserver started at http://127.12.159.193:33485/ using document root <none> and password file <none>
I20260923 19:35:50.858026 16575 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:50.858134 16575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:50.858410 16575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:50.861308 16575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "2e5cc9ddc7d84ea08c5f08d689456558"
format_stamp: "Formatted at 2026-09-23 19:35:50 on dist-test-slave-lzv7"
server_key: "8279c5c6d394739cf79e7fa0595cf018"
server_key_iv: "ae60946d19a5e1a387f9286c2d6de304"
server_key_version: "encryptionkey@0"
I20260923 19:35:50.862340 16575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "2e5cc9ddc7d84ea08c5f08d689456558"
format_stamp: "Formatted at 2026-09-23 19:35:50 on dist-test-slave-lzv7"
server_key: "8279c5c6d394739cf79e7fa0595cf018"
server_key_iv: "ae60946d19a5e1a387f9286c2d6de304"
server_key_version: "encryptionkey@0"
I20260923 19:35:50.868088 16575 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:50.871894 16590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:50.873327 16575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:50.873502 16575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "2e5cc9ddc7d84ea08c5f08d689456558"
format_stamp: "Formatted at 2026-09-23 19:35:50 on dist-test-slave-lzv7"
server_key: "8279c5c6d394739cf79e7fa0595cf018"
server_key_iv: "ae60946d19a5e1a387f9286c2d6de304"
server_key_version: "encryptionkey@0"
I20260923 19:35:50.873713 16575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:50.891278 16575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:50.895923 16575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:50.896226 16575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:50.897220 16575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:50.898630 16575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:50.898739 16575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:50.898896 16575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:50.898969 16575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:50.933310 16575 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:43969
I20260923 19:35:50.933339 16702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:43969 every 8 connection(s)
I20260923 19:35:50.934688 16575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:50.942204 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 16575
I20260923 19:35:50.942440 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:50.943269 12927 external_mini_cluster.cc:1428] Setting key a853efecf9be59b6ddb4558a7376da32
Sep 23 19:35:50 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192150, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:50.956732 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:50.937554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:47477 (local address 127.12.159.254:45855)
0923 19:35:50.938035 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:50.938042 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:50.939034 (+ 992us) server_negotiation.cc:407] Connection header received
0923 19:35:50.940818 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:50.940824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:50.940912 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:50.941058 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:50.942806 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:50.943877 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:50.946045 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:50.946799 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:50.946949 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:50.950532 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:50.950540 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:50.950546 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:50.950591 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:50.953424 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:50.954415 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:50.954419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:50.954421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:50.954559 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:50.955042 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:50.955044 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:50.955046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:50.955287 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:50.955394 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:50.956307 (+ 913us) server_negotiation.cc:299] Negotiation successful
0923 19:35:50.956473 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":207,"threads_started":1}
I20260923 19:35:50.958372 16706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:50.938148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45855 (local address 127.12.159.193:47477)
0923 19:35:50.938865 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:50.938912 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:50.940527 (+ 1615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:50.941269 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:50.941277 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:50.941911 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:50.942615 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:50.942642 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:50.944068 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:50.944075 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:50.945896 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:50.945908 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:50.947035 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:50.947040 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:50.947245 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:50.947972 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:50.947995 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:50.950233 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:50.953580 (+ 3347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:50.953593 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:50.953614 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:50.954290 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:50.954671 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:50.954679 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:50.954685 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:50.954930 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:50.955424 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:50.955435 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:50.955911 (+ 476us) client_negotiation.cc:769] Sending connection context
0923 19:35:50.956212 (+ 301us) client_negotiation.cc:240] Negotiation successful
0923 19:35:50.956809 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":284,"threads_started":1}
I20260923 19:35:50.960270 16703 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45855
I20260923 19:35:50.960615 16703 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:50.961385 16703 heartbeater.cc:511] Master 127.12.159.254:45855 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:35:50.963752 16514 ts_manager.cc:194] Registered new tserver with Master: 2e5cc9ddc7d84ea08c5f08d689456558 (127.12.159.193:43969)
I20260923 19:35:50.965150 16514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:47477
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:50.989481 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45855
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:51.317242 16709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:51.317555 16709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:51.317651 16709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:51.325091 16709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:51.325207 16709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:51.325388 16709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:51.335440 16709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:51.336726 16709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:51.338124 16709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:51.351765 16714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:51.351732 16717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:51.351735 16715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:51.352746 16709 server_base.cc:1034] running on GCE node
I20260923 19:35:51.353384 16709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:51.354415 16709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:51.355708 16709 hybrid_clock.cc:648] HybridClock initialized: now 1790192151355657 us; error 45 us; skew 500 ppm
I20260923 19:35:51.356086 16709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:51 dist-test-slave-lzv7 krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192151, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:51.359414 16709 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:51.361371 16709 webserver.cc:460] Webserver started at http://127.12.159.194:36125/ using document root <none> and password file <none>
I20260923 19:35:51.362262 16709 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:51.362421 16709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:51.362773 16709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:51.366199 16709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "e9425fc70b1a469c9e0855c30a880486"
format_stamp: "Formatted at 2026-09-23 19:35:51 on dist-test-slave-lzv7"
server_key: "5f06c14053d5aeb46da0d00d6151e3ef"
server_key_iv: "818059f2775b0f20858543a959351b2b"
server_key_version: "encryptionkey@0"
I20260923 19:35:51.367177 16709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "e9425fc70b1a469c9e0855c30a880486"
format_stamp: "Formatted at 2026-09-23 19:35:51 on dist-test-slave-lzv7"
server_key: "5f06c14053d5aeb46da0d00d6151e3ef"
server_key_iv: "818059f2775b0f20858543a959351b2b"
server_key_version: "encryptionkey@0"
I20260923 19:35:51.373061 16709 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:35:51.377220 16724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:51.378893 16709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:35:51.379096 16709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "e9425fc70b1a469c9e0855c30a880486"
format_stamp: "Formatted at 2026-09-23 19:35:51 on dist-test-slave-lzv7"
server_key: "5f06c14053d5aeb46da0d00d6151e3ef"
server_key_iv: "818059f2775b0f20858543a959351b2b"
server_key_version: "encryptionkey@0"
I20260923 19:35:51.379374 16709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:51.405719 16709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:51.410372 16709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:51.410696 16709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:51.411725 16709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:51.413188 16709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:51.413297 16709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:51.413444 16709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:51.413524 16709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:51.448063 16709 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:44383
I20260923 19:35:51.448176 16836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:44383 every 8 connection(s)
I20260923 19:35:51.449411 16709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:51.449864 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 16709
I20260923 19:35:51.450074 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:51.450724 12927 external_mini_cluster.cc:1428] Setting key 752ceb6a79ff849e478afa274b7bc9c5
Sep 23 19:35:51 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192151, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
I20260923 19:35:51.474807 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:51.452148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:47679 (local address 127.12.159.254:45855)
0923 19:35:51.452348 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:51.452355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:51.453752 (+ 1397us) server_negotiation.cc:407] Connection header received
0923 19:35:51.455643 (+ 1891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:51.455651 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:51.455748 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:51.455864 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:51.457387 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.458268 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.460929 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.461364 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.461470 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:51.466356 (+ 4886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:51.466362 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:51.466366 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:51.466405 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:51.470433 (+ 4028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:51.471614 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:51.471622 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:51.471626 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:51.471821 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:51.472259 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:51.472262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:51.472264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:51.472798 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:51.472981 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:51.474140 (+ 1159us) server_negotiation.cc:299] Negotiation successful
0923 19:35:51.474436 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:35:51.476112 16839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:51.452716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45855 (local address 127.12.159.194:47679)
0923 19:35:51.453555 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:51.453611 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:51.455363 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:51.456063 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:51.456071 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:51.456612 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:51.457205 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:51.457223 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.458438 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.458443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:51.460764 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:51.460782 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.461630 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.461639 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:51.462000 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:51.462787 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:51.462822 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:51.466044 (+ 3222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:51.470818 (+ 4774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:51.470826 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:51.470842 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:51.471453 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:51.471961 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:51.471965 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:51.471967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:51.472153 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:51.472974 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:51.472983 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:51.473570 (+ 587us) client_negotiation.cc:769] Sending connection context
0923 19:35:51.473975 (+ 405us) client_negotiation.cc:240] Negotiation successful
0923 19:35:51.474526 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":348,"threads_started":1}
I20260923 19:35:51.477787 16837 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45855
I20260923 19:35:51.478230 16837 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:51.479032 16837 heartbeater.cc:511] Master 127.12.159.254:45855 requested a full tablet report, sending...
I20260923 19:35:51.480697 16514 ts_manager.cc:194] Registered new tserver with Master: e9425fc70b1a469c9e0855c30a880486 (127.12.159.194:44383)
I20260923 19:35:51.481492 16514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:47679
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:51.501971 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45855
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:51.832301 16842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:51.832657 16842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:51.832839 16842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:51.840401 16842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:51.840577 16842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:51.840768 16842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:51.851068 16842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45855
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:51.852521 16842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:51.853904 16842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:51.867909 16850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:51.867960 16847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:51.867991 16848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:51.868779 16842 server_base.cc:1034] running on GCE node
I20260923 19:35:51.869491 16842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:51.871052 16842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:51.872318 16842 hybrid_clock.cc:648] HybridClock initialized: now 1790192151872235 us; error 89 us; skew 500 ppm
I20260923 19:35:51.872685 16842 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:51 dist-test-slave-lzv7 krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192151, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:51.882477 16842 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:51.884315 16842 webserver.cc:460] Webserver started at http://127.12.159.195:38757/ using document root <none> and password file <none>
I20260923 19:35:51.885146 16842 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:51.885265 16842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:51.885538 16842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:51.888790 16842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "4666f207b9a8424683d5aa876db14397"
format_stamp: "Formatted at 2026-09-23 19:35:51 on dist-test-slave-lzv7"
server_key: "d081fdfe672de4e8431b6e8d50476bf4"
server_key_iv: "5d52518a44532c0c0f4a3b3a8d5f8dcb"
server_key_version: "encryptionkey@0"
I20260923 19:35:51.889621 16842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "4666f207b9a8424683d5aa876db14397"
format_stamp: "Formatted at 2026-09-23 19:35:51 on dist-test-slave-lzv7"
server_key: "d081fdfe672de4e8431b6e8d50476bf4"
server_key_iv: "5d52518a44532c0c0f4a3b3a8d5f8dcb"
server_key_version: "encryptionkey@0"
I20260923 19:35:51.895450 16842 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:35:51.899410 16857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:51.901078 16842 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:51.901257 16842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "4666f207b9a8424683d5aa876db14397"
format_stamp: "Formatted at 2026-09-23 19:35:51 on dist-test-slave-lzv7"
server_key: "d081fdfe672de4e8431b6e8d50476bf4"
server_key_iv: "5d52518a44532c0c0f4a3b3a8d5f8dcb"
server_key_version: "encryptionkey@0"
I20260923 19:35:51.901458 16842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:51.917117 16842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:51.921567 16842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:51.921940 16842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:51.923054 16842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:51.924517 16842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:51.924590 16842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:51.924731 16842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:51.924794 16842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:51.959920 16842 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:42491
I20260923 19:35:51.959968 16969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:42491 every 8 connection(s)
I20260923 19:35:51.961293 16842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:51.962479 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 16842
I20260923 19:35:51.962687 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:51.963198 12927 external_mini_cluster.cc:1428] Setting key faabd7d44d07cec2693144a77a6d41de
I20260923 19:35:51.968513 16703 heartbeater.cc:503] Master 127.12.159.254:45855 was elected leader, sending a full tablet report...
Sep 23 19:35:51 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192151, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:51.983839 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:51.964430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:41911 (local address 127.12.159.254:45855)
0923 19:35:51.964650 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:51.964657 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:51.965996 (+ 1339us) server_negotiation.cc:407] Connection header received
0923 19:35:51.967930 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:51.967934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:51.968007 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:51.968099 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:51.969987 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.970935 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.972605 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.973088 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.973209 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:51.977010 (+ 3801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:51.977020 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:51.977027 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:51.977084 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:51.980334 (+ 3250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:51.981257 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:51.981261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:51.981264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:51.981397 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:51.981968 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:51.981971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:51.981974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:51.982288 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:51.982416 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:51.983293 (+ 877us) server_negotiation.cc:299] Negotiation successful
0923 19:35:51.983541 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:35:51.984918 16972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:51.964869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45855 (local address 127.12.159.195:41911)
0923 19:35:51.965800 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:51.965875 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:51.967660 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:51.968378 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:51.968390 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:51.969125 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:51.969753 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:51.969779 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.971147 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.971152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:51.972451 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:51.972463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:51.973295 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:51.973300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:51.973504 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:51.974322 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:51.974345 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:51.976679 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:51.980475 (+ 3796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:51.980483 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:51.980500 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:51.981104 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:51.981536 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:51.981540 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:51.981543 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:51.981749 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:51.982456 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:51.982464 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:51.982878 (+ 414us) client_negotiation.cc:769] Sending connection context
0923 19:35:51.983163 (+ 285us) client_negotiation.cc:240] Negotiation successful
0923 19:35:51.983707 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":413,"threads_started":1}
I20260923 19:35:51.986642 16970 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45855
I20260923 19:35:51.987025 16970 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:51.987813 16970 heartbeater.cc:511] Master 127.12.159.254:45855 requested a full tablet report, sending...
I20260923 19:35:51.989409 16514 ts_manager.cc:194] Registered new tserver with Master: 4666f207b9a8424683d5aa876db14397 (127.12.159.195:42491)
I20260923 19:35:51.990433 16514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:41911
I20260923 19:35:51.992556 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:52.043936 16977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:52.027889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.12.159.193:43969)
0923 19:35:52.028651 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:52.028658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:52.028713 (+ 55us) server_negotiation.cc:407] Connection header received
0923 19:35:52.028834 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:52.028841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:52.029060 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:52.029183 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:52.030735 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.031899 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.033133 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.033710 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.033877 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:52.038041 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:52.038053 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:52.038067 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:52.038104 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:52.040964 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.041670 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.041677 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.041679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.041802 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.042267 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.042270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.042272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.042624 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:52.042859 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:52.043233 (+ 374us) server_negotiation.cc:299] Negotiation successful
0923 19:35:52.043473 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":442,"threads_started":1}
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:52.063565 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:52.048391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42750 (local address 127.12.159.254:45855)
0923 19:35:52.048575 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:52.048579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:52.048925 (+ 346us) server_negotiation.cc:407] Connection header received
0923 19:35:52.049057 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:52.049061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:52.049128 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:52.049294 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:52.050818 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.051566 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.052900 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.053309 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.053411 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:52.057453 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:52.057459 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:52.057462 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:52.057502 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:52.060580 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.061433 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.061438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.061442 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.061606 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.062166 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.062170 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.062173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.062515 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:52.062709 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:52.063129 (+ 420us) server_negotiation.cc:299] Negotiation successful
0923 19:35:52.063311 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260923 19:35:52.064138 16513 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42750
I20260923 19:35:52.065230 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16575
I20260923 19:35:52.078832 16977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:52.066344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.12.159.193:43969)
0923 19:35:52.066611 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:52.066618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:52.066790 (+ 172us) server_negotiation.cc:407] Connection header received
0923 19:35:52.066933 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:52.066938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:52.067008 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:52.067102 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:52.068236 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.068935 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.070291 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.070751 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.070926 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:52.073182 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:52.073187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:52.073190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:52.073226 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:52.076000 (+ 2774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.076734 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.076738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.076740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.076934 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.077329 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.077333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.077335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.077580 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:52.077862 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:52.078242 (+ 380us) server_negotiation.cc:299] Negotiation successful
0923 19:35:52.078448 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260923 19:35:52.079525 16698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:52.164938 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 16575
I20260923 19:35:52.181545 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16709
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:35:52.198088 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:52.182555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35738 (local address 127.12.159.194:44383)
0923 19:35:52.183152 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:52.183160 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:52.183185 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:35:52.183245 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:52.183251 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:52.183524 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:52.183702 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:52.185102 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.186233 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.187553 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.188124 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.188267 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:52.192420 (+ 4153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:52.192432 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:52.192446 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:52.192490 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:52.195283 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.195955 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.195962 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.195964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.196087 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.196468 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.196473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.196477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.196813 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:52.197141 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:52.197438 (+ 297us) server_negotiation.cc:299] Negotiation successful
0923 19:35:52.197700 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":269,"threads_started":1}
I20260923 19:35:52.199371 16832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:52.282445 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 16709
I20260923 19:35:52.299173 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16842
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:35:52.315902 16984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:52.300166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52532 (local address 127.12.159.195:42491)
0923 19:35:52.300793 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:52.300799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:52.300827 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:35:52.300896 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:52.300903 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:52.301114 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:52.301300 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:52.302652 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.303649 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.305018 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:52.305556 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:52.305695 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:52.309907 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:52.309919 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:52.309933 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:52.309965 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:52.312833 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.313530 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.313541 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.313549 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.313665 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:52.314285 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:52.314292 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:52.314295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:52.314633 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:52.314954 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:52.315243 (+ 289us) server_negotiation.cc:299] Negotiation successful
0923 19:35:52.315511 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":332,"threads_started":1}
I20260923 19:35:52.317389 16965 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:52.400918 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 16842
I20260923 19:35:52.417050 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 16482
I20260923 19:35:52.418411 16544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:52.524103 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 16482
2026-09-23T19:35:52Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3938 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16989](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16989](info): set up 2 sockets
Sep 23 19:35:52 dist-test-slave-lzv7 krb5kdc[16989](info): commencing operation
krb5kdc: starting...
W20260923 19:35:53.658463 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.004s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:35:53 dist-test-slave-lzv7 krb5kdc[16989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:35:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:35:53.870266 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33029
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:54.200855 17002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:54.201138 17002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:54.201313 17002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:54.208734 17002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:54.208847 17002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:54.208920 17002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:54.209004 17002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:54.209088 17002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:54.219374 17002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:54.220741 17002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:54.222069 17002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:54.233572 17007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:54.233717 17008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:54.233728 17010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:54.234990 17002 server_base.cc:1034] running on GCE node
I20260923 19:35:54.235776 17002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:54.237226 17002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:54.238481 17002 hybrid_clock.cc:648] HybridClock initialized: now 1790192154238439 us; error 49 us; skew 500 ppm
I20260923 19:35:54.238821 17002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:54 dist-test-slave-lzv7 krb5kdc[16989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:54.241909 17002 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:35:54.243084 17002 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:54.243218 17002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:54.243556 17002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:54.246568 17002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "d3a3d0acf027400d8aab44e16cc98306"
format_stamp: "Formatted at 2026-09-23 19:35:54 on dist-test-slave-lzv7"
server_key: "530dac99f836add4cecb864fee067e58"
server_key_iv: "4d60d12b00316cbcb3563d96ff28b6af"
server_key_version: "encryptionkey@0"
I20260923 19:35:54.247351 17002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "d3a3d0acf027400d8aab44e16cc98306"
format_stamp: "Formatted at 2026-09-23 19:35:54 on dist-test-slave-lzv7"
server_key: "530dac99f836add4cecb864fee067e58"
server_key_iv: "4d60d12b00316cbcb3563d96ff28b6af"
server_key_version: "encryptionkey@0"
I20260923 19:35:54.252518 17002 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:54.256099 17016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:54.257422 17002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:35:54.257642 17002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "d3a3d0acf027400d8aab44e16cc98306"
format_stamp: "Formatted at 2026-09-23 19:35:54 on dist-test-slave-lzv7"
server_key: "530dac99f836add4cecb864fee067e58"
server_key_iv: "4d60d12b00316cbcb3563d96ff28b6af"
server_key_version: "encryptionkey@0"
I20260923 19:35:54.257896 17002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:54.277891 17002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:54.282191 17002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:54.282488 17002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:54.301188 17002 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:33029
I20260923 19:35:54.301209 17067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:33029 every 8 connection(s)
I20260923 19:35:54.302184 17002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:54.306061 17068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:54.310348 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17002
I20260923 19:35:54.310585 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:54.311368 12927 external_mini_cluster.cc:1428] Setting key 792786b3d21c87fee4e1ac65c42c5472
I20260923 19:35:54.318073 17068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306: Bootstrap starting.
I20260923 19:35:54.321723 17068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:54.322904 17068 log.cc:824] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:54.325735 17068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306: No bootstrap required, opened a new log
Sep 23 19:35:54 dist-test-slave-lzv7 krb5kdc[16989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:54.334906 17068 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3a3d0acf027400d8aab44e16cc98306" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33029 } }
I20260923 19:35:54.335292 17068 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:54.335428 17068 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3a3d0acf027400d8aab44e16cc98306, State: Initialized, Role: FOLLOWER
I20260923 19:35:54.335862 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:54.313553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43494 (local address 127.12.159.254:33029)
0923 19:35:54.314471 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:54.314485 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:54.314525 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:35:54.316454 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:54.316479 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:54.316878 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:54.317202 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:54.319064 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:54.320414 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:54.322303 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:54.322972 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:54.323187 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:54.327641 (+ 4454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:54.327652 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:54.327666 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:54.327716 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:54.330956 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:54.331821 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:54.331827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:54.331834 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:54.332031 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:54.332506 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:54.332510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:54.332513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:54.333253 (+ 740us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:54.333508 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:54.334060 (+ 552us) server_negotiation.cc:299] Negotiation successful
0923 19:35:54.334511 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":501,"threads_started":1}
I20260923 19:35:54.336148 17068 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3a3d0acf027400d8aab44e16cc98306" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33029 } }
I20260923 19:35:54.336444 17068 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:54.336611 17068 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:54.336814 17068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:54.339722 17068 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3a3d0acf027400d8aab44e16cc98306" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33029 } }
I20260923 19:35:54.340224 17068 leader_election.cc:302] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3a3d0acf027400d8aab44e16cc98306; no voters:
I20260923 19:35:54.340875 17068 leader_election.cc:288] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:54.341034 17073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:54.341845 17073 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [term 1 LEADER]: Becoming Leader. State: Replica: d3a3d0acf027400d8aab44e16cc98306, State: Running, Role: LEADER
I20260923 19:35:54.342370 17073 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3a3d0acf027400d8aab44e16cc98306" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33029 } }
I20260923 19:35:54.343110 17068 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:54.345630 17075 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3a3d0acf027400d8aab44e16cc98306. Latest consensus state: current_term: 1 leader_uuid: "d3a3d0acf027400d8aab44e16cc98306" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3a3d0acf027400d8aab44e16cc98306" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33029 } } }
I20260923 19:35:54.346014 17075 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:54.345721 17074 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3a3d0acf027400d8aab44e16cc98306" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3a3d0acf027400d8aab44e16cc98306" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33029 } } }
I20260923 19:35:54.346169 17074 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:54.349341 17079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:54.355288 17079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:54.364071 17079 catalog_manager.cc:1347] Generated new cluster ID: 87da8f161724411287b2e5b3125a05cd
I20260923 19:35:54.364197 17079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:54.391240 17079 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:54.393054 17079 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:54.401753 17079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306: Generated new TSK 0
I20260923 19:35:54.402686 17079 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:35:54.447697 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33029
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:54.783298 17094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:54.783577 17094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:54.783742 17094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:54.791471 17094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:54.791608 17094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:54.791827 17094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:54.801986 17094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33029
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:54.803400 17094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:54.804751 17094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:54.817711 17102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:54.817683 17099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:54.817826 17100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:54.823618 17094 server_base.cc:1034] running on GCE node
I20260923 19:35:54.824309 17094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:54.825358 17094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:54.826665 17094 hybrid_clock.cc:648] HybridClock initialized: now 1790192154826592 us; error 65 us; skew 500 ppm
I20260923 19:35:54.827028 17094 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:54 dist-test-slave-lzv7 krb5kdc[16989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:54.830636 17094 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:35:54.831995 17094 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:54.832149 17094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:54.832525 17094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:54.835614 17094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "9f7baf464b3241b89c173315a9c8e7c8"
format_stamp: "Formatted at 2026-09-23 19:35:54 on dist-test-slave-lzv7"
server_key: "4bf056c477d3c1e115fe2aa00959ad3c"
server_key_iv: "9099d429e6c1af657f8b1aeead068cc0"
server_key_version: "encryptionkey@0"
I20260923 19:35:54.836663 17094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "9f7baf464b3241b89c173315a9c8e7c8"
format_stamp: "Formatted at 2026-09-23 19:35:54 on dist-test-slave-lzv7"
server_key: "4bf056c477d3c1e115fe2aa00959ad3c"
server_key_iv: "9099d429e6c1af657f8b1aeead068cc0"
server_key_version: "encryptionkey@0"
I20260923 19:35:54.842253 17094 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:35:54.846143 17108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:54.847625 17094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:54.847815 17094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "9f7baf464b3241b89c173315a9c8e7c8"
format_stamp: "Formatted at 2026-09-23 19:35:54 on dist-test-slave-lzv7"
server_key: "4bf056c477d3c1e115fe2aa00959ad3c"
server_key_iv: "9099d429e6c1af657f8b1aeead068cc0"
server_key_version: "encryptionkey@0"
I20260923 19:35:54.848042 17094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:54.870821 17094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:54.875337 17094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:54.875634 17094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:54.876650 17094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:54.878170 17094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:54.878289 17094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:54.878432 17094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:54.878520 17094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:54.912458 17094 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:34173
I20260923 19:35:54.912544 17220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:34173 every 8 connection(s)
I20260923 19:35:54.913412 17094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:54.917665 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17094
I20260923 19:35:54.917933 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:54.918785 12927 external_mini_cluster.cc:1428] Setting key 61da7cee5df9ebcb3fd4008a23738716
Sep 23 19:35:54 dist-test-slave-lzv7 krb5kdc[16989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:54.938655 17223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:54.916165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:50483 (local address 127.12.159.254:33029)
0923 19:35:54.916615 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:54.916621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:54.917895 (+ 1274us) server_negotiation.cc:407] Connection header received
0923 19:35:54.920255 (+ 2360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:54.920261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:54.920358 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:54.920499 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:54.922910 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:54.923618 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:54.926362 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:54.926787 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:54.926892 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:54.931042 (+ 4150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:54.931052 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:54.931060 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:54.931109 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:54.934933 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:54.935781 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:54.935790 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:54.935796 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:54.935963 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:54.936471 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:54.936478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:54.936484 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:54.936906 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:54.937091 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:54.937941 (+ 850us) server_negotiation.cc:299] Negotiation successful
0923 19:35:54.938229 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":214,"threads_started":1}
I20260923 19:35:54.939566 17224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:54.916772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33029 (local address 127.12.159.193:50483)
0923 19:35:54.917672 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:54.917724 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:54.919982 (+ 2258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:54.920920 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:54.920932 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:54.921755 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:54.922711 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:54.922741 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:54.923794 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:54.923803 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:54.926193 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:54.926212 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:54.927039 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:54.927059 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:54.927343 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:54.928095 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:54.928119 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:54.930764 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:54.935114 (+ 4350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:54.935122 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:54.935138 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:54.935618 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:54.936124 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:54.936128 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:54.936130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:54.936332 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:54.937068 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:54.937076 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:54.937433 (+ 357us) client_negotiation.cc:769] Sending connection context
0923 19:35:54.937753 (+ 320us) client_negotiation.cc:240] Negotiation successful
0923 19:35:54.938353 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":343,"threads_started":1}
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:35:54.941351 17221 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33029
I20260923 19:35:54.941762 17221 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:54.942610 17221 heartbeater.cc:511] Master 127.12.159.254:33029 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
I20260923 19:35:54.945200 17033 ts_manager.cc:194] Registered new tserver with Master: 9f7baf464b3241b89c173315a9c8e7c8 (127.12.159.193:34173)
I20260923 19:35:54.947433 17033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:50483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:35:54.970438 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33029
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:55.291221 17227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:55.291518 17227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:55.291682 17227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:55.298969 17227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:55.299093 17227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:55.299311 17227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:55.309190 17227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33029
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:55.310575 17227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:55.311900 17227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:55.324877 17232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:55.326012 17233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:55.326097 17235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:55.326138 17227 server_base.cc:1034] running on GCE node
I20260923 19:35:55.326879 17227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:55.327935 17227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:55.329180 17227 hybrid_clock.cc:648] HybridClock initialized: now 1790192155329105 us; error 65 us; skew 500 ppm
I20260923 19:35:55.329566 17227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:55 dist-test-slave-lzv7 krb5kdc[16989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:55.333161 17227 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:35:55.334440 17227 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:55.334587 17227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:55.334945 17227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:55.338253 17227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "3aada966c9f3443db7470848a77b27a3"
format_stamp: "Formatted at 2026-09-23 19:35:55 on dist-test-slave-lzv7"
server_key: "1dfd59e7afa91037727a66e668976f20"
server_key_iv: "d49d07dcd74f10ba66a783f7f34afd51"
server_key_version: "encryptionkey@0"
I20260923 19:35:55.339133 17227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "3aada966c9f3443db7470848a77b27a3"
format_stamp: "Formatted at 2026-09-23 19:35:55 on dist-test-slave-lzv7"
server_key: "1dfd59e7afa91037727a66e668976f20"
server_key_iv: "d49d07dcd74f10ba66a783f7f34afd51"
server_key_version: "encryptionkey@0"
I20260923 19:35:55.344703 17227 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:35:55.348407 17241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:55.350134 17227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:35:55.350320 17227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "3aada966c9f3443db7470848a77b27a3"
format_stamp: "Formatted at 2026-09-23 19:35:55 on dist-test-slave-lzv7"
server_key: "1dfd59e7afa91037727a66e668976f20"
server_key_iv: "d49d07dcd74f10ba66a783f7f34afd51"
server_key_version: "encryptionkey@0"
I20260923 19:35:55.350580 17227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:55.371269 17227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:55.375761 17227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:55.376058 17227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:55.377097 17227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:55.378569 17227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:55.378738 17227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:55.378880 17227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:55.378971 17227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:55.413008 17227 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:35409
I20260923 19:35:55.413021 17353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:35409 every 8 connection(s)
I20260923 19:35:55.414041 17227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:55.420584 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17227
I20260923 19:35:55.420789 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:55.421348 12927 external_mini_cluster.cc:1428] Setting key 37d773cd85833a1d58504ccc42bd450a
Sep 23 19:35:55 dist-test-slave-lzv7 krb5kdc[16989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:55.438190 17223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:55.416525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:60399 (local address 127.12.159.254:33029)
0923 19:35:55.416747 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:55.416753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:55.417958 (+ 1205us) server_negotiation.cc:407] Connection header received
0923 19:35:55.419811 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:55.419816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:55.419888 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:55.419983 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:55.422251 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.423413 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.426038 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.426479 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.426596 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:55.431276 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:55.431281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:55.431285 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:55.431321 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:55.434279 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:55.435343 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:55.435347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:55.435349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:55.435469 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:55.436046 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:55.436051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:55.436053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:55.436395 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:55.436552 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:55.437569 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0923 19:35:55.437791 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:35:55.439823 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:55.417065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33029 (local address 127.12.159.194:60399)
0923 19:35:55.417751 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:55.417790 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:55.419548 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:55.420272 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:55.420286 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:55.421062 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:55.422020 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:55.422042 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.423579 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.423583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:55.425851 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:55.425872 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.426748 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.426757 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:55.427095 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:55.427876 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:55.427910 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:55.430989 (+ 3079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:55.434439 (+ 3450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:55.434453 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:55.434477 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:55.435192 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:55.435582 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:55.435591 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:55.435598 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:55.435878 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:55.436559 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:55.436571 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:55.437087 (+ 516us) client_negotiation.cc:769] Sending connection context
0923 19:35:55.437426 (+ 339us) client_negotiation.cc:240] Negotiation successful
0923 19:35:55.438152 (+ 726us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":275,"threads_started":1}
I20260923 19:35:55.441787 17354 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33029
I20260923 19:35:55.442215 17354 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:55.443086 17354 heartbeater.cc:511] Master 127.12.159.254:33029 requested a full tablet report, sending...
I20260923 19:35:55.445013 17033 ts_manager.cc:194] Registered new tserver with Master: 3aada966c9f3443db7470848a77b27a3 (127.12.159.194:35409)
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:35:55.446264 17033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:60399
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:35:55.474189 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33029
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:35:55.811721 17359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:55.812026 17359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:55.812201 17359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:55.819847 17359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:55.819962 17359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:55.820171 17359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:55.830272 17359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33029
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:55.831643 17359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:55.833050 17359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:55.847349 17364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:55.847373 17365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:55.847394 17367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:55.848403 17359 server_base.cc:1034] running on GCE node
I20260923 19:35:55.849117 17359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:55.850255 17359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:55.851493 17359 hybrid_clock.cc:648] HybridClock initialized: now 1790192155851426 us; error 62 us; skew 500 ppm
I20260923 19:35:55.851817 17359 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:35:55 dist-test-slave-lzv7 krb5kdc[16989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:35:55.855388 17359 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:35:55.856581 17359 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:55.856678 17359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:55.856943 17359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:55.859943 17359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "d2bfa4496ecd4fc1a6b15537075baa06"
format_stamp: "Formatted at 2026-09-23 19:35:55 on dist-test-slave-lzv7"
server_key: "678b4f3dd2141bf60feb36a8e0378093"
server_key_iv: "05a3446896dfbd7d8dddfabe1d01a329"
server_key_version: "encryptionkey@0"
I20260923 19:35:55.860746 17359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "d2bfa4496ecd4fc1a6b15537075baa06"
format_stamp: "Formatted at 2026-09-23 19:35:55 on dist-test-slave-lzv7"
server_key: "678b4f3dd2141bf60feb36a8e0378093"
server_key_iv: "05a3446896dfbd7d8dddfabe1d01a329"
server_key_version: "encryptionkey@0"
I20260923 19:35:55.867448 17359 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260923 19:35:55.871840 17373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:55.873867 17359 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.002s
I20260923 19:35:55.874076 17359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "d2bfa4496ecd4fc1a6b15537075baa06"
format_stamp: "Formatted at 2026-09-23 19:35:55 on dist-test-slave-lzv7"
server_key: "678b4f3dd2141bf60feb36a8e0378093"
server_key_iv: "05a3446896dfbd7d8dddfabe1d01a329"
server_key_version: "encryptionkey@0"
I20260923 19:35:55.874559 17359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:55.911108 17359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:55.919050 17359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:55.919389 17359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:55.920620 17359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:55.922082 17359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:55.922175 17359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:55.922260 17359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:55.922319 17359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:55.951227 17221 heartbeater.cc:503] Master 127.12.159.254:33029 was elected leader, sending a full tablet report...
I20260923 19:35:55.958928 17359 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:38667
I20260923 19:35:55.958986 17485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:38667 every 8 connection(s)
I20260923 19:35:55.959895 17359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:55.964169 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17359
I20260923 19:35:55.964378 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:55.964816 12927 external_mini_cluster.cc:1428] Setting key 4da16517f83e31dc25c11c82ca1daab9
Sep 23 19:35:55 dist-test-slave-lzv7 krb5kdc[16989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:35:55.980877 17488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:55.962569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:56149 (local address 127.12.159.254:33029)
0923 19:35:55.963050 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:55.963055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:55.964050 (+ 995us) server_negotiation.cc:407] Connection header received
0923 19:35:55.966390 (+ 2340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:55.966394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:55.966474 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:55.966596 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:55.968454 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.969203 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.970841 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.971282 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.971435 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:55.975020 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:55.975024 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:55.975028 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:55.975061 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:55.977499 (+ 2438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:55.978326 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:55.978331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:55.978333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:55.978456 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:55.978884 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:55.978890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:55.978898 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:55.979166 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:55.979327 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:55.980185 (+ 858us) server_negotiation.cc:299] Negotiation successful
0923 19:35:55.980460 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":291,"threads_started":1}
I20260923 19:35:55.981874 17489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:55.963161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33029 (local address 127.12.159.195:56149)
0923 19:35:55.963898 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:55.963942 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:55.965996 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:55.966833 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:55.966842 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:55.967602 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:55.968283 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:55.968300 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.969362 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.969385 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:55.970694 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:55.970706 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:55.971516 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:55.971523 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:55.971750 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:55.972406 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:35:55.972427 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:55.974767 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:55.977664 (+ 2897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:55.977673 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:55.977697 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:55.978192 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:55.978569 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:35:55.978574 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:35:55.978578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:35:55.978766 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:35:55.979299 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:55.979307 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:55.979670 (+ 363us) client_negotiation.cc:769] Sending connection context
0923 19:35:55.979989 (+ 319us) client_negotiation.cc:240] Negotiation successful
0923 19:35:55.980565 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":290,"threads_started":1}
I20260923 19:35:55.983230 17486 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33029
I20260923 19:35:55.983565 17486 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:55.984215 17486 heartbeater.cc:511] Master 127.12.159.254:33029 requested a full tablet report, sending...
I20260923 19:35:55.985631 17033 ts_manager.cc:194] Registered new tserver with Master: d2bfa4496ecd4fc1a6b15537075baa06 (127.12.159.195:38667)
I20260923 19:35:55.986508 17033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:56149
I20260923 19:35:55.993076 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:35:56.009975 17488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:55.997678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43498 (local address 127.12.159.254:33029)
0923 19:35:55.997925 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:55.997934 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:55.998267 (+ 333us) server_negotiation.cc:407] Connection header received
0923 19:35:55.998414 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:55.998418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:55.998493 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:55.998573 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:55.999931 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.000636 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.001893 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.002307 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.002411 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.004782 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:56.004787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:56.004790 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:56.004820 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:56.007605 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.008234 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.008238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.008240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.008347 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.008655 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.008657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.008659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.008963 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:56.009133 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.009397 (+ 264us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.009561 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:35:56.014271 17033 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:56.021173 17033 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:56.057785 17501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.033790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:35409 (local address 127.0.0.1:36906)
0923 19:35:56.041860 (+ 8070us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:56.049074 (+ 7214us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:56.049222 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:56.050391 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:56.050395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:56.050425 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:56.050864 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.050877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.052864 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.052873 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.055258 (+ 2385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.055271 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.056693 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.056703 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.056941 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.057005 (+ 64us) client_negotiation.cc:769] Sending connection context
0923 19:35:56.057117 (+ 112us) client_negotiation.cc:240] Negotiation successful
0923 19:35:56.057323 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7918,"mutex_wait_us":64,"thread_start_us":7747,"threads_started":1}
I20260923 19:35:56.058495 17502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.034564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36906 (local address 127.12.159.194:35409)
0923 19:35:56.048653 (+ 14089us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.048668 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.049234 (+ 566us) server_negotiation.cc:407] Connection header received
0923 19:35:56.049434 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.049446 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.049757 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.050410 (+ 653us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:56.051050 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.052714 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.055420 (+ 2706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.056460 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.057664 (+ 1204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.057913 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.058002 (+ 89us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.058165 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13854,"thread_start_us":13728,"threads_started":1}
I20260923 19:35:56.058557 17499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.033624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:34173 (local address 127.0.0.1:50764)
0923 19:35:56.041012 (+ 7388us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:56.041053 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:56.041225 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:56.049976 (+ 8751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:56.049985 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:56.050030 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:56.050534 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.050551 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.052810 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.052817 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.055448 (+ 2631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.055462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.057672 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.057679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.057892 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.057922 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 19:35:56.058000 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 19:35:56.058134 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7107,"mutex_wait_us":81,"thread_start_us":5981,"threads_started":1}
I20260923 19:35:56.059369 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.041987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:38667 (local address 127.0.0.1:57248)
0923 19:35:56.050271 (+ 8284us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:56.050290 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:56.050512 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:56.051383 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:56.051387 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:56.051417 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:56.051759 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.051770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.053878 (+ 2108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.053883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.056204 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.056217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.058731 (+ 2514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.058736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.058892 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.058921 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:35:56.059006 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 19:35:56.059107 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8154,"mutex_wait_us":61,"thread_start_us":8006,"threads_started":1}
I20260923 19:35:56.059551 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.033846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.12.159.193:34173)
0923 19:35:56.049165 (+ 15319us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.049173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.049206 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:35:56.049326 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.049338 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.049652 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.050727 (+ 1075us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:56.050974 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.052679 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.055642 (+ 2963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.057416 (+ 1774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.058838 (+ 1422us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.059019 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.059089 (+ 70us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.059247 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15104,"thread_start_us":14899,"threads_started":1}
I20260923 19:35:56.060130 17504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.042379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57248 (local address 127.12.159.195:38667)
0923 19:35:56.049777 (+ 7398us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.049788 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.050380 (+ 592us) server_negotiation.cc:407] Connection header received
0923 19:35:56.050705 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.050718 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.050893 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.051061 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:56.051995 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.053678 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.056392 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.058218 (+ 1826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.058432 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.058547 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.059598 (+ 1051us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.059792 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7205,"thread_start_us":7593,"threads_started":1}
I20260923 19:35:56.062667 17289 tablet_service.cc:1467] Processing CreateTablet for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 (DEFAULT_TABLE table=test-table [id=2bd958b354dd4f7bb0331661f5889293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:56.063114 17156 tablet_service.cc:1467] Processing CreateTablet for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 (DEFAULT_TABLE table=test-table [id=2bd958b354dd4f7bb0331661f5889293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:56.064116 17289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:56.063764 17421 tablet_service.cc:1467] Processing CreateTablet for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 (DEFAULT_TABLE table=test-table [id=2bd958b354dd4f7bb0331661f5889293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:56.064476 17156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:56.065107 17421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:56.074945 17505 tablet_bootstrap.cc:492] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Bootstrap starting.
I20260923 19:35:56.078174 17505 tablet_bootstrap.cc:654] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:56.079949 17505 log.cc:824] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:56.082538 17507 tablet_bootstrap.cc:492] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Bootstrap starting.
I20260923 19:35:56.083295 17505 tablet_bootstrap.cc:492] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: No bootstrap required, opened a new log
I20260923 19:35:56.083566 17505 ts_tablet_manager.cc:1397] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:35:56.085965 17506 tablet_bootstrap.cc:492] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Bootstrap starting.
I20260923 19:35:56.086146 17507 tablet_bootstrap.cc:654] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:56.087347 17507 log.cc:824] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:56.088940 17506 tablet_bootstrap.cc:654] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:56.090159 17506 log.cc:824] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:56.090606 17507 tablet_bootstrap.cc:492] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: No bootstrap required, opened a new log
I20260923 19:35:56.090862 17507 ts_tablet_manager.cc:1397] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:35:56.094374 17505 raft_consensus.cc:348] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.094975 17505 raft_consensus.cc:374] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:56.095077 17505 raft_consensus.cc:729] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aada966c9f3443db7470848a77b27a3, State: Initialized, Role: FOLLOWER
I20260923 19:35:56.095746 17505 consensus_queue.cc:260] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.096882 17506 tablet_bootstrap.cc:492] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: No bootstrap required, opened a new log
I20260923 19:35:56.096988 17354 heartbeater.cc:503] Master 127.12.159.254:33029 was elected leader, sending a full tablet report...
I20260923 19:35:56.097168 17506 ts_tablet_manager.cc:1397] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.005s
I20260923 19:35:56.097627 17505 ts_tablet_manager.cc:1428] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260923 19:35:56.101071 17507 raft_consensus.cc:348] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.101588 17507 raft_consensus.cc:374] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:56.101709 17507 raft_consensus.cc:729] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2bfa4496ecd4fc1a6b15537075baa06, State: Initialized, Role: FOLLOWER
I20260923 19:35:56.102398 17507 consensus_queue.cc:260] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.104758 17486 heartbeater.cc:503] Master 127.12.159.254:33029 was elected leader, sending a full tablet report...
I20260923 19:35:56.105408 17507 ts_tablet_manager.cc:1428] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260923 19:35:56.106160 17506 raft_consensus.cc:348] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.106581 17506 raft_consensus.cc:374] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:56.106688 17506 raft_consensus.cc:729] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7baf464b3241b89c173315a9c8e7c8, State: Initialized, Role: FOLLOWER
I20260923 19:35:56.107352 17506 consensus_queue.cc:260] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.108954 17506 ts_tablet_manager.cc:1428] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
W20260923 19:35:56.166118 17222 tablet.cc:2369] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:35:56.166241 17355 tablet.cc:2369] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:35:56.211587 17487 tablet.cc:2369] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:35:56.280944 17512 raft_consensus.cc:482] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:56.281272 17512 raft_consensus.cc:504] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.283082 17512 leader_election.cc:288] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f7baf464b3241b89c173315a9c8e7c8 (127.12.159.193:34173), 3aada966c9f3443db7470848a77b27a3 (127.12.159.194:35409)
I20260923 19:35:56.288750 17489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.283589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:35409 (local address 127.12.159.195:57507)
0923 19:35:56.283893 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:56.283914 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:56.284050 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:56.284403 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:56.284409 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:56.284435 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:56.284628 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.284637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.285627 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.285635 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.287064 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.287075 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.288203 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.288207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.288346 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.288369 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:35:56.288453 (+ 84us) client_negotiation.cc:240] Negotiation successful
0923 19:35:56.288546 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":43}
I20260923 19:35:56.288873 17502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.283677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:57507 (local address 127.12.159.194:35409)
0923 19:35:56.283886 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.283895 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.284001 (+ 106us) server_negotiation.cc:407] Connection header received
0923 19:35:56.284220 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.284224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.284279 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.284373 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:56.284769 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.285503 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.287216 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.288062 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.288223 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.288298 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.288492 (+ 194us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.288623 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 19:35:56.289913 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.283634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:37817 (local address 127.12.159.193:34173)
0923 19:35:56.283944 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.283953 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.284517 (+ 564us) server_negotiation.cc:407] Connection header received
0923 19:35:56.284736 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.284740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.284795 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.284894 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:35:56.285387 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.286138 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.287905 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.289069 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.289235 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.289303 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.289582 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.289677 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173}
I20260923 19:35:56.290104 17514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.283647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:34173 (local address 127.12.159.195:37817)
0923 19:35:56.284388 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:56.284402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:56.284589 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:56.284909 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:56.284913 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:56.284935 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:35:56.285239 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.285248 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.286301 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.286306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.287744 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:35:56.287759 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.289248 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.289253 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:35:56.289408 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.289431 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:35:56.289552 (+ 121us) client_negotiation.cc:240] Negotiation successful
0923 19:35:56.289688 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":3,"thread_start_us":421,"threads_started":1}
I20260923 19:35:56.290048 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4821144863eb4f7bb39ad4a6fcf1c9b4" candidate_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aada966c9f3443db7470848a77b27a3" is_pre_election: true
I20260923 19:35:56.290850 17309 raft_consensus.cc:2454] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2bfa4496ecd4fc1a6b15537075baa06 in term 0.
I20260923 19:35:56.291317 17176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4821144863eb4f7bb39ad4a6fcf1c9b4" candidate_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7baf464b3241b89c173315a9c8e7c8" is_pre_election: true
I20260923 19:35:56.291766 17376 leader_election.cc:302] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3aada966c9f3443db7470848a77b27a3, d2bfa4496ecd4fc1a6b15537075baa06; no voters:
I20260923 19:35:56.291807 17176 raft_consensus.cc:2454] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2bfa4496ecd4fc1a6b15537075baa06 in term 0.
I20260923 19:35:56.292209 17512 raft_consensus.cc:2781] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:56.292379 17512 raft_consensus.cc:482] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:56.292505 17512 raft_consensus.cc:3037] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:56.294807 17512 raft_consensus.cc:504] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.295528 17512 leader_election.cc:288] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [CANDIDATE]: Term 1 election: Requested vote from peers 9f7baf464b3241b89c173315a9c8e7c8 (127.12.159.193:34173), 3aada966c9f3443db7470848a77b27a3 (127.12.159.194:35409)
I20260923 19:35:56.296041 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4821144863eb4f7bb39ad4a6fcf1c9b4" candidate_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3aada966c9f3443db7470848a77b27a3"
I20260923 19:35:56.296080 17176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4821144863eb4f7bb39ad4a6fcf1c9b4" candidate_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f7baf464b3241b89c173315a9c8e7c8"
I20260923 19:35:56.296262 17176 raft_consensus.cc:3037] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:56.296262 17309 raft_consensus.cc:3037] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:56.299544 17176 raft_consensus.cc:2454] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2bfa4496ecd4fc1a6b15537075baa06 in term 1.
I20260923 19:35:56.299569 17309 raft_consensus.cc:2454] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2bfa4496ecd4fc1a6b15537075baa06 in term 1.
I20260923 19:35:56.299954 17376 leader_election.cc:302] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3aada966c9f3443db7470848a77b27a3, d2bfa4496ecd4fc1a6b15537075baa06; no voters:
I20260923 19:35:56.300235 17512 raft_consensus.cc:2781] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:56.300730 17512 raft_consensus.cc:686] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 1 LEADER]: Becoming Leader. State: Replica: d2bfa4496ecd4fc1a6b15537075baa06, State: Running, Role: LEADER
I20260923 19:35:56.301314 17512 consensus_queue.cc:237] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } }
I20260923 19:35:56.306545 17032 catalog_manager.cc:5495] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2bfa4496ecd4fc1a6b15537075baa06 (127.12.159.195). New cstate: current_term: 1 leader_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2bfa4496ecd4fc1a6b15537075baa06" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 38667 } health_report { overall_health: HEALTHY } } }
I20260923 19:35:56.349259 17504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.343760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57258 (local address 127.12.159.195:38667)
0923 19:35:56.344035 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.344042 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.344172 (+ 130us) server_negotiation.cc:407] Connection header received
0923 19:35:56.344432 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.344437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.344512 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.344668 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:35:56.345030 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.345755 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.347134 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.347521 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.347648 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.348139 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:35:56.348658 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:35:56.348834 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.348884 (+ 50us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.348974 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:35:56.358011 17309 raft_consensus.cc:1261] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 1 FOLLOWER]: Refusing update from remote peer d2bfa4496ecd4fc1a6b15537075baa06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:56.358011 17176 raft_consensus.cc:1261] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 1 FOLLOWER]: Refusing update from remote peer d2bfa4496ecd4fc1a6b15537075baa06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:56.359400 17512 consensus_queue.cc:1035] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f7baf464b3241b89c173315a9c8e7c8" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:56.359767 17515 consensus_queue.cc:1035] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3aada966c9f3443db7470848a77b27a3" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:56.371672 17518 mvcc.cc:205] Tried to move back new op lower bound from 7332627072430333952 to 7332627072213905408. Current Snapshot: MvccSnapshot[applied={T|T < 7332627072430333952}]
I20260923 19:35:56.388751 17033 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:56.389060 17033 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:56.393437 17033 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3a3d0acf027400d8aab44e16cc98306: Sending DeleteTablet for 3 replicas of tablet 4821144863eb4f7bb39ad4a6fcf1c9b4
I20260923 19:35:56.394999 17156 tablet_service.cc:1514] Processing DeleteTablet for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:56 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:50764
I20260923 19:35:56.395104 17289 tablet_service.cc:1514] Processing DeleteTablet for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:56 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:36906
I20260923 19:35:56.395424 17421 tablet_service.cc:1514] Processing DeleteTablet for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:56 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:57248
I20260923 19:35:56.395357 17155 tablet_service.cc:1514] Processing DeleteTablet for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:56 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:50764
I20260923 19:35:56.397267 17529 tablet_replica.cc:330] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: stopping tablet replica
I20260923 19:35:56.397385 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17094
I20260923 19:35:56.397751 17529 raft_consensus.cc:2229] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:56.398329 17529 raft_consensus.cc:2258] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:56.399113 17530 tablet_replica.cc:330] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: stopping tablet replica
I20260923 19:35:56.399550 17530 raft_consensus.cc:2229] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:56.400321 17530 raft_consensus.cc:2258] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:56.401293 17528 tablet_replica.cc:330] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: stopping tablet replica
I20260923 19:35:56.401837 17528 raft_consensus.cc:2229] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:56.402455 17528 raft_consensus.cc:2258] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:56.402716 17530 ts_tablet_manager.cc:1905] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:56.403357 17529 ts_tablet_manager.cc:1905] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:56.404917 17528 ts_tablet_manager.cc:1905] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:56.410342 17530 ts_tablet_manager.cc:1918] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:56.410571 17530 log.cc:1196] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/4821144863eb4f7bb39ad4a6fcf1c9b4
I20260923 19:35:56.411192 17530 ts_tablet_manager.cc:1939] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P d2bfa4496ecd4fc1a6b15537075baa06: Deleting consensus metadata
I20260923 19:35:56.413290 17019 catalog_manager.cc:4841] TS d2bfa4496ecd4fc1a6b15537075baa06 (127.12.159.195:38667): tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 (table test-table [id=2bd958b354dd4f7bb0331661f5889293]) successfully deleted
I20260923 19:35:56.414146 17528 ts_tablet_manager.cc:1918] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:56.414338 17528 log.cc:1196] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/4821144863eb4f7bb39ad4a6fcf1c9b4
I20260923 19:35:56.414902 17528 ts_tablet_manager.cc:1939] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 3aada966c9f3443db7470848a77b27a3: Deleting consensus metadata
I20260923 19:35:56.416612 17019 catalog_manager.cc:4841] TS 3aada966c9f3443db7470848a77b27a3 (127.12.159.194:35409): tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 (table test-table [id=2bd958b354dd4f7bb0331661f5889293]) successfully deleted
I20260923 19:35:56.419586 17529 ts_tablet_manager.cc:1918] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:56.419817 17529 log.cc:1196] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/4821144863eb4f7bb39ad4a6fcf1c9b4
I20260923 19:35:56.420388 17529 ts_tablet_manager.cc:1939] T 4821144863eb4f7bb39ad4a6fcf1c9b4 P 9f7baf464b3241b89c173315a9c8e7c8: Deleting consensus metadata
I20260923 19:35:56.422516 17020 catalog_manager.cc:4841] TS 9f7baf464b3241b89c173315a9c8e7c8 (127.12.159.193:34173): tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 (table test-table [id=2bd958b354dd4f7bb0331661f5889293]) successfully deleted
W20260923 19:35:56.423412 17020 catalog_manager.cc:4808] TS 9f7baf464b3241b89c173315a9c8e7c8 (127.12.159.193:34173): delete failed for tablet 4821144863eb4f7bb39ad4a6fcf1c9b4 because the tablet was not found. No further retry: Not found: Tablet not found: 4821144863eb4f7bb39ad4a6fcf1c9b4
Sep 23 19:35:56 dist-test-slave-lzv7 krb5kdc[16989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:35:56.434516 17500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.398724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50776 (local address 127.12.159.193:34173)
0923 19:35:56.398896 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.398904 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.414133 (+ 15229us) server_negotiation.cc:407] Connection header received
0923 19:35:56.414422 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.414429 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.414521 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.414645 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:56.417390 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.418620 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.420798 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.421543 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.421639 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.427209 (+ 5570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:56.427225 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:56.427242 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:56.427285 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:56.431053 (+ 3768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.431971 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.431981 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.431985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.432153 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.432678 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.432684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.432688 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.433194 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:56.433500 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.433914 (+ 414us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.434147 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:35:56.435374 17216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:56.530506 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17094
I20260923 19:35:56.555109 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17227
Sep 23 19:35:56 dist-test-slave-lzv7 krb5kdc[16989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:35:56.574299 17502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.556020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36910 (local address 127.12.159.194:35409)
0923 19:35:56.556249 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.556255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.556400 (+ 145us) server_negotiation.cc:407] Connection header received
0923 19:35:56.556572 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.556578 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.556664 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.556771 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:56.558545 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.559708 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.561755 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.562423 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.562546 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.567985 (+ 5439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:56.568005 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:56.568028 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:56.568103 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:56.571125 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.572006 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.572016 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.572019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.572145 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.572599 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.572604 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.572606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.573024 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:56.573297 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.573693 (+ 396us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.573942 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:35:56.575057 17349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:56.666508 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17227
I20260923 19:35:56.689499 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17359
Sep 23 19:35:56 dist-test-slave-lzv7 krb5kdc[16989](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:35:56.708535 17504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:56.690543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57266 (local address 127.12.159.195:38667)
0923 19:35:56.690711 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:56.690715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:56.690739 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:35:56.690960 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:56.690964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:56.691090 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:56.691174 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:56.693157 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.694107 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.696061 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:35:56.696548 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:35:56.696654 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:35:56.702388 (+ 5734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:56.702403 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:56.702418 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:35:56.702461 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:56.705571 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.706308 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.706324 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.706327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.706494 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:35:56.706893 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:35:56.706898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:35:56.706902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:35:56.707278 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:56.707615 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:56.707909 (+ 294us) server_negotiation.cc:299] Negotiation successful
0923 19:35:56.708146 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 19:35:56.709393 17481 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:56.830293 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17359
I20260923 19:35:56.849421 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17002
I20260923 19:35:56.850827 17063 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:56.960382 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17002
2026-09-23T19:35:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4433 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-23T19:35:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:57Z Disabled control of system clock
I20260923 19:35:57.028803 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:37263
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:37263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 19:35:57.349939 17539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:57.350251 17539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:57.350337 17539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:57.357731 17539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:57.357897 17539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:57.357959 17539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:57.358021 17539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:57.358067 17539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:35:57.367723 17539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:37263
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:37263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:57.368990 17539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:57.370827 17539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:57.382786 17545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:57.382718 17547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:57.383283 17544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:57.383848 17539 server_base.cc:1034] running on GCE node
I20260923 19:35:57.384640 17539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:57.386260 17539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:57.387508 17539 hybrid_clock.cc:648] HybridClock initialized: now 1790192157387445 us; error 59 us; skew 500 ppm
I20260923 19:35:57.387880 17539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:35:57.396345 17539 webserver.cc:460] Webserver started at http://127.12.159.254:33725/ using document root <none> and password file <none>
I20260923 19:35:57.397138 17539 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:57.397284 17539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:57.397620 17539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:57.400705 17539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "1514892da5694de4889ee64518592314"
format_stamp: "Formatted at 2026-09-23 19:35:57 on dist-test-slave-lzv7"
server_key: "ab1c476451c9ae4cee310fd9a5db3540"
server_key_iv: "3164699850b3bc50bcf83bd3f95f8e35"
server_key_version: "encryptionkey@0"
I20260923 19:35:57.401551 17539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "1514892da5694de4889ee64518592314"
format_stamp: "Formatted at 2026-09-23 19:35:57 on dist-test-slave-lzv7"
server_key: "ab1c476451c9ae4cee310fd9a5db3540"
server_key_iv: "3164699850b3bc50bcf83bd3f95f8e35"
server_key_version: "encryptionkey@0"
I20260923 19:35:57.406900 17539 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260923 19:35:57.410516 17553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:57.411890 17539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:57.412081 17539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "1514892da5694de4889ee64518592314"
format_stamp: "Formatted at 2026-09-23 19:35:57 on dist-test-slave-lzv7"
server_key: "ab1c476451c9ae4cee310fd9a5db3540"
server_key_iv: "3164699850b3bc50bcf83bd3f95f8e35"
server_key_version: "encryptionkey@0"
I20260923 19:35:57.412312 17539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:57.418236 17539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:57.419011 17539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:57.419317 17539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:57.438444 17539 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:37263
I20260923 19:35:57.438481 17604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:37263 every 8 connection(s)
I20260923 19:35:57.439888 17539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:35:57.443724 17605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:57.448217 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17539
I20260923 19:35:57.448432 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:35:57.449252 12927 external_mini_cluster.cc:1428] Setting key 81366d4e7be38466c41b25f38ff11f6a
I20260923 19:35:57.455876 17605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314: Bootstrap starting.
I20260923 19:35:57.458237 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:57.451515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57624 (local address 127.12.159.254:37263)
0923 19:35:57.452615 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:57.452627 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:57.452675 (+ 48us) server_negotiation.cc:407] Connection header received
0923 19:35:57.454520 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:57.454552 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:57.454976 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:57.455376 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:57.456531 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:57.456538 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:57.456550 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:57.456564 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:57.456622 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:57.456638 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:57.456862 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:57.456994 (+ 132us) server_negotiation.cc:299] Negotiation successful
0923 19:35:57.457250 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":426,"threads_started":1}
I20260923 19:35:57.459336 17605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:57.460382 17605 log.cc:824] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:57.463161 17605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314: No bootstrap required, opened a new log
I20260923 19:35:57.470901 17605 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1514892da5694de4889ee64518592314" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 37263 } }
I20260923 19:35:57.471304 17605 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:57.471416 17605 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1514892da5694de4889ee64518592314, State: Initialized, Role: FOLLOWER
I20260923 19:35:57.471982 17605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1514892da5694de4889ee64518592314" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 37263 } }
I20260923 19:35:57.472232 17605 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:35:57.472375 17605 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:35:57.472548 17605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:57.475075 17605 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1514892da5694de4889ee64518592314" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 37263 } }
I20260923 19:35:57.475584 17605 leader_election.cc:302] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1514892da5694de4889ee64518592314; no voters:
I20260923 19:35:57.476191 17605 leader_election.cc:288] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:35:57.476343 17610 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:57.477162 17610 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [term 1 LEADER]: Becoming Leader. State: Replica: 1514892da5694de4889ee64518592314, State: Running, Role: LEADER
I20260923 19:35:57.477694 17610 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1514892da5694de4889ee64518592314" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 37263 } }
I20260923 19:35:57.478494 17605 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:35:57.480937 17612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1514892da5694de4889ee64518592314. Latest consensus state: current_term: 1 leader_uuid: "1514892da5694de4889ee64518592314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1514892da5694de4889ee64518592314" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 37263 } } }
I20260923 19:35:57.481379 17612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:57.482545 17611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1514892da5694de4889ee64518592314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1514892da5694de4889ee64518592314" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 37263 } } }
I20260923 19:35:57.482918 17611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314 [sys.catalog]: This master's current role is: LEADER
I20260923 19:35:57.485078 17619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:35:57.490613 17619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:35:57.499912 17619 catalog_manager.cc:1347] Generated new cluster ID: 90a013cd02dd484b8021dadbe677899c
I20260923 19:35:57.500029 17619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:35:57.522595 17619 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:35:57.523123 17619 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:35:57.531608 17619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314: Generated new TSK 0
I20260923 19:35:57.532701 17619 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:35:57.546474 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:37263
--builtin_ntp_servers=127.12.159.212:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 19:35:57.886533 17629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:57.886817 17629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:57.886974 17629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:57.894446 17629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:57.894548 17629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:57.894712 17629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:35:57.903955 17629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:37263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:57.905287 17629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:57.907091 17629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:57.920678 17637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:57.920771 17635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:57.920955 17634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:57.921926 17629 server_base.cc:1034] running on GCE node
I20260923 19:35:57.922626 17629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:57.923764 17629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:57.924984 17629 hybrid_clock.cc:648] HybridClock initialized: now 1790192157924916 us; error 61 us; skew 500 ppm
I20260923 19:35:57.925323 17629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:35:57.927774 17629 webserver.cc:460] Webserver started at http://127.12.159.193:34873/ using document root <none> and password file <none>
I20260923 19:35:57.928547 17629 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:57.928637 17629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:57.929014 17629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:57.932034 17629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "ac0504ab619848deb4ba85a8587a73b4"
format_stamp: "Formatted at 2026-09-23 19:35:57 on dist-test-slave-lzv7"
server_key: "2866271f27ea7dbc2e9955e28f5fade6"
server_key_iv: "4392bfb3c416d942c6f1040a0b3f88b0"
server_key_version: "encryptionkey@0"
I20260923 19:35:57.932876 17629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "ac0504ab619848deb4ba85a8587a73b4"
format_stamp: "Formatted at 2026-09-23 19:35:57 on dist-test-slave-lzv7"
server_key: "2866271f27ea7dbc2e9955e28f5fade6"
server_key_iv: "4392bfb3c416d942c6f1040a0b3f88b0"
server_key_version: "encryptionkey@0"
I20260923 19:35:57.938460 17629 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:35:57.942175 17643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:57.943564 17629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:57.943746 17629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "ac0504ab619848deb4ba85a8587a73b4"
format_stamp: "Formatted at 2026-09-23 19:35:57 on dist-test-slave-lzv7"
server_key: "2866271f27ea7dbc2e9955e28f5fade6"
server_key_iv: "4392bfb3c416d942c6f1040a0b3f88b0"
server_key_version: "encryptionkey@0"
I20260923 19:35:57.943979 17629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:57.949936 17629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:57.950739 17629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:57.951022 17629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:57.951959 17629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:57.953449 17629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:57.953580 17629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:57.953719 17629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:57.953840 17629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:57.988585 17629 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:41483
I20260923 19:35:57.988673 17755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:41483 every 8 connection(s)
I20260923 19:35:57.990018 17629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:35:57.998680 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:57.992697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:48727 (local address 127.12.159.254:37263)
0923 19:35:57.993168 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:57.993172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:57.994569 (+ 1397us) server_negotiation.cc:407] Connection header received
0923 19:35:57.996265 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:57.996270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:57.996336 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:57.996443 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:57.997800 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:57.997868 (+ 68us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:57.997875 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:57.997907 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:57.997953 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:57.997968 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:57.998084 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:57.998314 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 19:35:57.998367 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":254,"threads_started":1}
I20260923 19:35:57.999087 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17629
I20260923 19:35:57.999287 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:35:57.999743 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:57.993373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:37263 (local address 127.12.159.193:48727)
0923 19:35:57.994393 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:57.994442 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:57.995992 (+ 1550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:57.996650 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:57.996657 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:57.996751 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:57.997496 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:57.997499 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:57.997537 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:57.997623 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:57.998096 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:57.998105 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:57.998111 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:35:57.998349 (+ 238us) client_negotiation.cc:240] Negotiation successful
0923 19:35:57.998622 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":264,"threads_started":1}
I20260923 19:35:57.999938 12927 external_mini_cluster.cc:1428] Setting key 024c0d350dc0579604b37fc8a57587cc
I20260923 19:35:58.001526 17756 heartbeater.cc:347] Connected to a master server at 127.12.159.254:37263
I20260923 19:35:58.001902 17756 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:58.002588 17756 heartbeater.cc:511] Master 127.12.159.254:37263 requested a full tablet report, sending...
I20260923 19:35:58.002985 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:37263
--builtin_ntp_servers=127.12.159.212:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260923 19:35:58.004746 17570 ts_manager.cc:194] Registered new tserver with Master: ac0504ab619848deb4ba85a8587a73b4 (127.12.159.193:41483)
W20260923 19:35:58.326792 17760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:58.327071 17760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:58.327159 17760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:58.334396 17760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:58.334498 17760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:58.334609 17760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:35:58.343801 17760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:37263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:58.345049 17760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:58.346779 17760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:58.359833 17768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:58.359867 17765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:58.360075 17766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:58.360605 17760 server_base.cc:1034] running on GCE node
I20260923 19:35:58.361258 17760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:58.362323 17760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:58.363583 17760 hybrid_clock.cc:648] HybridClock initialized: now 1790192158363529 us; error 49 us; skew 500 ppm
I20260923 19:35:58.363919 17760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:35:58.366288 17760 webserver.cc:460] Webserver started at http://127.12.159.194:33547/ using document root <none> and password file <none>
I20260923 19:35:58.366988 17760 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:58.367121 17760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:58.367527 17760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:58.370427 17760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "6b4e177e58c54596a9e5e3c6d4cba520"
format_stamp: "Formatted at 2026-09-23 19:35:58 on dist-test-slave-lzv7"
server_key: "746fc4f7ca2de1f7f154bd5fdf84b696"
server_key_iv: "9efa2de8b81a2fcfe787bad0183e3fc8"
server_key_version: "encryptionkey@0"
I20260923 19:35:58.371206 17760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "6b4e177e58c54596a9e5e3c6d4cba520"
format_stamp: "Formatted at 2026-09-23 19:35:58 on dist-test-slave-lzv7"
server_key: "746fc4f7ca2de1f7f154bd5fdf84b696"
server_key_iv: "9efa2de8b81a2fcfe787bad0183e3fc8"
server_key_version: "encryptionkey@0"
I20260923 19:35:58.376441 17760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:35:58.380326 17774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:58.381743 17760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260923 19:35:58.381980 17760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "6b4e177e58c54596a9e5e3c6d4cba520"
format_stamp: "Formatted at 2026-09-23 19:35:58 on dist-test-slave-lzv7"
server_key: "746fc4f7ca2de1f7f154bd5fdf84b696"
server_key_iv: "9efa2de8b81a2fcfe787bad0183e3fc8"
server_key_version: "encryptionkey@0"
I20260923 19:35:58.382233 17760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:58.388005 17760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:58.388840 17760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:58.389201 17760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:58.390281 17760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:58.391706 17760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:58.391834 17760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:58.391954 17760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:58.392043 17760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:58.426977 17760 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:35307
I20260923 19:35:58.427065 17886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:35307 every 8 connection(s)
I20260923 19:35:58.428319 17760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:35:58.433307 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17760
I20260923 19:35:58.433516 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:35:58.434151 12927 external_mini_cluster.cc:1428] Setting key 5e45eedde007cbdddb7e9775f5ae9cbc
I20260923 19:35:58.437271 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:37263
--builtin_ntp_servers=127.12.159.212:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260923 19:35:58.438014 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.431144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:37341 (local address 127.12.159.254:37263)
0923 19:35:58.431337 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.431341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.432777 (+ 1436us) server_negotiation.cc:407] Connection header received
0923 19:35:58.435239 (+ 2462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.435246 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.435331 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.435418 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.437000 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.437013 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.437017 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.437033 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.437064 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.437075 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.437195 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.437540 (+ 345us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.437603 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:35:58.439041 17889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.431704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:37263 (local address 127.12.159.194:37341)
0923 19:35:58.432617 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:58.432659 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:58.434956 (+ 2297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:58.435722 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:58.435735 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:58.435871 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:58.436688 (+ 817us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:58.436691 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:58.436732 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:58.436826 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:58.437179 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:58.437190 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:58.437198 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 19:35:58.437522 (+ 324us) client_negotiation.cc:240] Negotiation successful
0923 19:35:58.437858 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":260,"threads_started":1}
I20260923 19:35:58.440618 17887 heartbeater.cc:347] Connected to a master server at 127.12.159.254:37263
I20260923 19:35:58.440948 17887 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:58.441671 17887 heartbeater.cc:511] Master 127.12.159.254:37263 requested a full tablet report, sending...
I20260923 19:35:58.443317 17570 ts_manager.cc:194] Registered new tserver with Master: 6b4e177e58c54596a9e5e3c6d4cba520 (127.12.159.194:35307)
W20260923 19:35:58.770270 17890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:58.770572 17890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:58.770727 17890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:58.778116 17890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:58.778231 17890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:58.778419 17890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:35:58.788182 17890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:37263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:58.789532 17890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:58.791399 17890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:35:58.805197 17895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:58.805161 17898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:35:58.805233 17896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:35:58.806066 17890 server_base.cc:1034] running on GCE node
I20260923 19:35:58.806674 17890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:35:58.807725 17890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:35:58.808969 17890 hybrid_clock.cc:648] HybridClock initialized: now 1790192158808907 us; error 48 us; skew 500 ppm
I20260923 19:35:58.809324 17890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:35:58.811988 17890 webserver.cc:460] Webserver started at http://127.12.159.195:36325/ using document root <none> and password file <none>
I20260923 19:35:58.812817 17890 fs_manager.cc:359] Metadata directory not provided
I20260923 19:35:58.812959 17890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:35:58.813326 17890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:35:58.816361 17890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "94f99911fda14d73aa6e96b0b3446f72"
format_stamp: "Formatted at 2026-09-23 19:35:58 on dist-test-slave-lzv7"
server_key: "36ad35d70afd5efbe7b84310d2d3f512"
server_key_iv: "c3b19c8b4d0986eb38d2cdb3d3c75f72"
server_key_version: "encryptionkey@0"
I20260923 19:35:58.817200 17890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "94f99911fda14d73aa6e96b0b3446f72"
format_stamp: "Formatted at 2026-09-23 19:35:58 on dist-test-slave-lzv7"
server_key: "36ad35d70afd5efbe7b84310d2d3f512"
server_key_iv: "c3b19c8b4d0986eb38d2cdb3d3c75f72"
server_key_version: "encryptionkey@0"
I20260923 19:35:58.822567 17890 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260923 19:35:58.826505 17904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:58.828020 17890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:35:58.828217 17890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "94f99911fda14d73aa6e96b0b3446f72"
format_stamp: "Formatted at 2026-09-23 19:35:58 on dist-test-slave-lzv7"
server_key: "36ad35d70afd5efbe7b84310d2d3f512"
server_key_iv: "c3b19c8b4d0986eb38d2cdb3d3c75f72"
server_key_version: "encryptionkey@0"
I20260923 19:35:58.828450 17890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:35:58.834221 17890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:35:58.835053 17890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:35:58.835335 17890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:35:58.836292 17890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:35:58.837730 17890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:35:58.837873 17890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:58.838003 17890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:35:58.838090 17890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:35:58.871907 17890 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:43615
I20260923 19:35:58.872040 18016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:43615 every 8 connection(s)
I20260923 19:35:58.873289 17890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:35:58.879549 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 17890
I20260923 19:35:58.879729 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:35:58.880322 12927 external_mini_cluster.cc:1428] Setting key 1c871ffd20d774d1cd92693af8f9df38
I20260923 19:35:58.883080 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.876228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:39875 (local address 127.12.159.254:37263)
0923 19:35:58.876425 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.876430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.877967 (+ 1537us) server_negotiation.cc:407] Connection header received
0923 19:35:58.880471 (+ 2504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.880480 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.880546 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.880649 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.882285 (+ 1636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.882292 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.882296 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.882321 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.882375 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.882391 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.882517 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.882722 (+ 205us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.882780 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:35:58.884128 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.876670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:37263 (local address 127.12.159.195:39875)
0923 19:35:58.877730 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:58.877771 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:58.880121 (+ 2350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:58.880934 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:58.880943 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:58.881042 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:58.881915 (+ 873us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:58.881918 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:58.882005 (+ 87us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:58.882113 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:58.882502 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:58.882512 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:58.882520 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 19:35:58.882783 (+ 263us) client_negotiation.cc:240] Negotiation successful
0923 19:35:58.883038 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":303,"threads_started":1}
I20260923 19:35:58.885494 18017 heartbeater.cc:347] Connected to a master server at 127.12.159.254:37263
I20260923 19:35:58.885874 18017 heartbeater.cc:464] Registering TS with master...
I20260923 19:35:58.886443 18017 heartbeater.cc:511] Master 127.12.159.254:37263 requested a full tablet report, sending...
I20260923 19:35:58.887847 17570 ts_manager.cc:194] Registered new tserver with Master: 94f99911fda14d73aa6e96b0b3446f72 (127.12.159.195:43615)
I20260923 19:35:58.895973 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:35:58.905251 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.902053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39504 (local address 127.12.159.254:37263)
0923 19:35:58.902232 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.902241 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.903080 (+ 839us) server_negotiation.cc:407] Connection header received
0923 19:35:58.903277 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.903285 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.903362 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.903476 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.904572 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.904579 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.904583 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.904605 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.904644 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.904659 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.904794 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.904925 (+ 131us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.904986 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 19:35:58.909484 17570 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:35:58.916406 17570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:35:58.935580 18032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.929483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40632 (local address 127.12.159.193:41483)
0923 19:35:58.931427 (+ 1944us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.931440 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.931476 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:35:58.931569 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.931580 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.931887 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.932889 (+ 1002us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.934573 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.934584 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.934600 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.934618 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.934716 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.934744 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.934909 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.935077 (+ 168us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.935236 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1734,"thread_start_us":1594,"threads_started":1}
I20260923 19:35:58.935736 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.928776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40632)
0923 19:35:58.930719 (+ 1943us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:58.930741 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:58.930840 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:58.932140 (+ 1300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:58.932152 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:58.932271 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:58.933274 (+ 1003us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:58.933280 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:58.933328 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:58.933443 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:58.934866 (+ 1423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:58.934876 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:58.934883 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 19:35:58.935108 (+ 225us) client_negotiation.cc:240] Negotiation successful
0923 19:35:58.935241 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1751,"thread_start_us":560,"threads_started":1}
I20260923 19:35:58.938053 18030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.928703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:43615 (local address 127.0.0.1:57236)
0923 19:35:58.929907 (+ 1204us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:58.929954 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:58.930101 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:58.934978 (+ 4877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:58.934983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:58.935006 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:58.936111 (+ 1105us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:58.936116 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:58.936135 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:58.936184 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:58.937433 (+ 1249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:58.937438 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:58.937443 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:35:58.937577 (+ 134us) client_negotiation.cc:240] Negotiation successful
0923 19:35:58.937631 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"thread_start_us":1645,"threads_started":1}
I20260923 19:35:58.938088 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.928852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57236 (local address 127.12.159.195:43615)
0923 19:35:58.934445 (+ 5593us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.934453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.934488 (+ 35us) server_negotiation.cc:407] Connection header received
0923 19:35:58.934561 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.934569 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.934791 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.935505 (+ 714us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.937212 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.937218 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.937228 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.937241 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.937312 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.937333 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.937501 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.937563 (+ 62us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.937657 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5403,"thread_start_us":5174,"threads_started":1}
I20260923 19:35:58.938674 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.931381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41654 (local address 127.12.159.194:35307)
0923 19:35:58.933463 (+ 2082us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.933496 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.934730 (+ 1234us) server_negotiation.cc:407] Connection header received
0923 19:35:58.934842 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.934852 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.935042 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.935188 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.937674 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.937682 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.937693 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.937711 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.937765 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.937788 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.937952 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.938219 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.938326 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":267,"threads_started":1}
I20260923 19:35:58.939422 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.930828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:35307 (local address 127.0.0.1:41654)
0923 19:35:58.934599 (+ 3771us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:58.934617 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:58.934727 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:58.936757 (+ 2030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:58.936765 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:58.936792 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:58.937433 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:58.937436 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:58.937453 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:58.937498 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:58.938056 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:58.938062 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:58.938068 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:35:58.938952 (+ 884us) client_negotiation.cc:240] Negotiation successful
0923 19:35:58.939002 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3662,"thread_start_us":3518,"threads_started":1}
I20260923 19:35:58.939955 17691 tablet_service.cc:1467] Processing CreateTablet for tablet 3690adaa0f724e3db4b4d08affef720b (DEFAULT_TABLE table=test-table [id=44ab036e89334cdc8575f304ee795263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:58.941440 17691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3690adaa0f724e3db4b4d08affef720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:58.942047 17952 tablet_service.cc:1467] Processing CreateTablet for tablet 3690adaa0f724e3db4b4d08affef720b (DEFAULT_TABLE table=test-table [id=44ab036e89334cdc8575f304ee795263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:58.942560 17822 tablet_service.cc:1467] Processing CreateTablet for tablet 3690adaa0f724e3db4b4d08affef720b (DEFAULT_TABLE table=test-table [id=44ab036e89334cdc8575f304ee795263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:35:58.943538 17952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3690adaa0f724e3db4b4d08affef720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:58.943720 17822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3690adaa0f724e3db4b4d08affef720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:35:58.955466 18035 tablet_bootstrap.cc:492] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Bootstrap starting.
I20260923 19:35:58.957541 18036 tablet_bootstrap.cc:492] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: Bootstrap starting.
I20260923 19:35:58.959877 18035 tablet_bootstrap.cc:654] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:58.960523 18037 tablet_bootstrap.cc:492] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Bootstrap starting.
I20260923 19:35:58.961018 18036 tablet_bootstrap.cc:654] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:58.961779 18035 log.cc:824] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:58.962231 18036 log.cc:824] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:58.963676 18037 tablet_bootstrap.cc:654] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Neither blocks nor log segments found. Creating new log.
I20260923 19:35:58.964689 18035 tablet_bootstrap.cc:492] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: No bootstrap required, opened a new log
I20260923 19:35:58.964789 18037 log.cc:824] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Log is configured to *not* fsync() on all Append() calls
I20260923 19:35:58.964983 18035 ts_tablet_manager.cc:1397] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.004s
I20260923 19:35:58.965224 18036 tablet_bootstrap.cc:492] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: No bootstrap required, opened a new log
I20260923 19:35:58.965509 18036 ts_tablet_manager.cc:1397] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260923 19:35:58.967804 18037 tablet_bootstrap.cc:492] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: No bootstrap required, opened a new log
I20260923 19:35:58.968091 18037 ts_tablet_manager.cc:1397] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:35:58.972514 18035 raft_consensus.cc:348] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.972882 18035 raft_consensus.cc:374] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:58.972976 18035 raft_consensus.cc:729] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4e177e58c54596a9e5e3c6d4cba520, State: Initialized, Role: FOLLOWER
I20260923 19:35:58.973603 18035 consensus_queue.cc:260] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.974714 17887 heartbeater.cc:503] Master 127.12.159.254:37263 was elected leader, sending a full tablet report...
I20260923 19:35:58.975394 18035 ts_tablet_manager.cc:1428] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Time spent starting tablet: real 0.010s user 0.008s sys 0.003s
I20260923 19:35:58.975880 18036 raft_consensus.cc:348] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.976338 18036 raft_consensus.cc:374] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:58.976431 18036 raft_consensus.cc:729] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac0504ab619848deb4ba85a8587a73b4, State: Initialized, Role: FOLLOWER
I20260923 19:35:58.977051 18036 consensus_queue.cc:260] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.978956 18036 ts_tablet_manager.cc:1428] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: Time spent starting tablet: real 0.013s user 0.004s sys 0.010s
I20260923 19:35:58.978840 18037 raft_consensus.cc:348] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.979279 18037 raft_consensus.cc:374] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:35:58.979387 18037 raft_consensus.cc:729] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f99911fda14d73aa6e96b0b3446f72, State: Initialized, Role: FOLLOWER
I20260923 19:35:58.980307 17756 heartbeater.cc:503] Master 127.12.159.254:37263 was elected leader, sending a full tablet report...
I20260923 19:35:58.980361 18037 consensus_queue.cc:260] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.982381 18017 heartbeater.cc:503] Master 127.12.159.254:37263 was elected leader, sending a full tablet report...
I20260923 19:35:58.983110 18037 ts_tablet_manager.cc:1428] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260923 19:35:58.983067 18041 raft_consensus.cc:482] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:35:58.983361 18041 raft_consensus.cc:504] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.985385 18041 leader_election.cc:288] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f99911fda14d73aa6e96b0b3446f72 (127.12.159.195:43615), ac0504ab619848deb4ba85a8587a73b4 (127.12.159.193:41483)
I20260923 19:35:58.989884 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.986044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:47363 (local address 127.12.159.195:43615)
0923 19:35:58.986286 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.986295 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.988134 (+ 1839us) server_negotiation.cc:407] Connection header received
0923 19:35:58.988250 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.988254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.988296 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.988373 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.989360 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.989364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.989367 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.989382 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.989410 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.989421 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.989518 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.989610 (+ 92us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.989653 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260923 19:35:58.990235 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.985745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:43615 (local address 127.12.159.194:47363)
0923 19:35:58.988018 (+ 2273us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:58.988035 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:58.988134 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:58.988423 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:58.988427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:58.988451 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:58.989162 (+ 711us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:58.989166 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:58.989183 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:58.989230 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:58.989510 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:58.989515 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:58.989519 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 19:35:58.989668 (+ 149us) client_negotiation.cc:240] Negotiation successful
0923 19:35:58.989722 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2150,"thread_start_us":1808,"threads_started":1}
I20260923 19:35:58.991159 17972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3690adaa0f724e3db4b4d08affef720b" candidate_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f99911fda14d73aa6e96b0b3446f72" is_pre_election: true
I20260923 19:35:58.991612 18032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.986592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:49253 (local address 127.12.159.193:41483)
0923 19:35:58.986815 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:58.986823 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:58.987261 (+ 438us) server_negotiation.cc:407] Connection header received
0923 19:35:58.987454 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:58.987462 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:58.987531 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:58.987643 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:58.990960 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:58.990965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:58.990970 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:58.990989 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:58.991028 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:58.991039 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:58.991163 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:58.991252 (+ 89us) server_negotiation.cc:299] Negotiation successful
0923 19:35:58.991319 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260923 19:35:58.991699 17972 raft_consensus.cc:2454] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4e177e58c54596a9e5e3c6d4cba520 in term 0.
I20260923 19:35:58.991735 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:58.985713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.12.159.194:49253)
0923 19:35:58.987158 (+ 1445us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:58.987174 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:35:58.987313 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:35:58.989970 (+ 2657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:35:58.989976 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:35:58.989999 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:35:58.990737 (+ 738us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:35:58.990742 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:35:58.990761 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:35:58.990804 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:35:58.991148 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:35:58.991153 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:35:58.991158 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:35:58.991288 (+ 130us) client_negotiation.cc:240] Negotiation successful
0923 19:35:58.991335 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1280,"thread_start_us":1114,"threads_started":1}
I20260923 19:35:58.992429 17777 leader_election.cc:302] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4e177e58c54596a9e5e3c6d4cba520, 94f99911fda14d73aa6e96b0b3446f72; no voters:
W20260923 19:35:58.992487 17757 tablet.cc:2369] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:35:58.992846 18041 raft_consensus.cc:2781] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:35:58.992970 18041 raft_consensus.cc:482] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:35:58.993055 18041 raft_consensus.cc:3037] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:58.993729 17711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3690adaa0f724e3db4b4d08affef720b" candidate_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac0504ab619848deb4ba85a8587a73b4" is_pre_election: true
I20260923 19:35:58.994304 17711 raft_consensus.cc:2454] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4e177e58c54596a9e5e3c6d4cba520 in term 0.
I20260923 19:35:58.996258 18041 raft_consensus.cc:504] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:58.996975 18041 leader_election.cc:288] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [CANDIDATE]: Term 1 election: Requested vote from peers 94f99911fda14d73aa6e96b0b3446f72 (127.12.159.195:43615), ac0504ab619848deb4ba85a8587a73b4 (127.12.159.193:41483)
I20260923 19:35:58.997473 17972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3690adaa0f724e3db4b4d08affef720b" candidate_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f99911fda14d73aa6e96b0b3446f72"
I20260923 19:35:58.997457 17711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3690adaa0f724e3db4b4d08affef720b" candidate_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac0504ab619848deb4ba85a8587a73b4"
I20260923 19:35:58.997676 17972 raft_consensus.cc:3037] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:58.997747 17711 raft_consensus.cc:3037] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:35:59.000613 17711 raft_consensus.cc:2454] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4e177e58c54596a9e5e3c6d4cba520 in term 1.
I20260923 19:35:59.001000 17972 raft_consensus.cc:2454] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4e177e58c54596a9e5e3c6d4cba520 in term 1.
I20260923 19:35:59.001071 17778 leader_election.cc:302] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4e177e58c54596a9e5e3c6d4cba520, ac0504ab619848deb4ba85a8587a73b4; no voters:
I20260923 19:35:59.001447 18041 raft_consensus.cc:2781] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:35:59.002012 18041 raft_consensus.cc:686] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 1 LEADER]: Becoming Leader. State: Replica: 6b4e177e58c54596a9e5e3c6d4cba520, State: Running, Role: LEADER
I20260923 19:35:59.002566 18041 consensus_queue.cc:237] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } }
I20260923 19:35:59.007958 17570 catalog_manager.cc:5495] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b4e177e58c54596a9e5e3c6d4cba520 (127.12.159.194). New cstate: current_term: 1 leader_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b4e177e58c54596a9e5e3c6d4cba520" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 35307 } health_report { overall_health: HEALTHY } } }
I20260923 19:35:59.039744 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.037740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.12.159.194:35307)
0923 19:35:59.037963 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:59.037967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:59.037986 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:35:59.038075 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:59.038079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:59.038159 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:59.038246 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:59.039112 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:59.039116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:59.039121 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:59.039137 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:59.039167 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:59.039179 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:59.039284 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:59.039379 (+ 95us) server_negotiation.cc:299] Negotiation successful
0923 19:35:59.039425 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260923 19:35:59.048552 17972 raft_consensus.cc:1261] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 1 FOLLOWER]: Refusing update from remote peer 6b4e177e58c54596a9e5e3c6d4cba520: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:59.048552 17711 raft_consensus.cc:1261] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4 [term 1 FOLLOWER]: Refusing update from remote peer 6b4e177e58c54596a9e5e3c6d4cba520: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:35:59.049774 18046 consensus_queue.cc:1035] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac0504ab619848deb4ba85a8587a73b4" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:59.050282 18041 consensus_queue.cc:1035] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f99911fda14d73aa6e96b0b3446f72" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:35:59.061321 18049 mvcc.cc:205] Tried to move back new op lower bound from 7332627083452227584 to 7332627083279101952. Current Snapshot: MvccSnapshot[applied={T|T < 7332627083452227584}]
I20260923 19:35:59.074965 17569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:59.075290 17569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:35:59.079195 17569 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1514892da5694de4889ee64518592314: Sending DeleteTablet for 3 replicas of tablet 3690adaa0f724e3db4b4d08affef720b
I20260923 19:35:59.080469 17952 tablet_service.cc:1514] Processing DeleteTablet for tablet 3690adaa0f724e3db4b4d08affef720b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:59 UTC) from {username='slave'} at 127.0.0.1:57236
I20260923 19:35:59.080474 17822 tablet_service.cc:1514] Processing DeleteTablet for tablet 3690adaa0f724e3db4b4d08affef720b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:59 UTC) from {username='slave'} at 127.0.0.1:41654
I20260923 19:35:59.081305 17691 tablet_service.cc:1514] Processing DeleteTablet for tablet 3690adaa0f724e3db4b4d08affef720b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:35:59 UTC) from {username='slave'} at 127.0.0.1:40632
I20260923 19:35:59.082561 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17629
I20260923 19:35:59.098460 18032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.084398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40638 (local address 127.12.159.193:41483)
0923 19:35:59.084623 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:59.084633 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:59.094944 (+ 10311us) server_negotiation.cc:407] Connection header received
0923 19:35:59.095557 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:59.095567 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:59.095713 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:59.095811 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:59.097351 (+ 1540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:59.097360 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:59.097368 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:59.097395 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:59.097444 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:59.097466 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:59.097595 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:59.097909 (+ 314us) server_negotiation.cc:299] Negotiation successful
0923 19:35:59.097992 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:35:59.099890 17751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:59.106616 18058 tablet_replica.cc:330] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: stopping tablet replica
I20260923 19:35:59.107268 18058 raft_consensus.cc:2229] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:35:59.107942 18058 raft_consensus.cc:2258] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:59.113227 18058 ts_tablet_manager.cc:1905] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:59.117393 18059 tablet_replica.cc:330] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: stopping tablet replica
I20260923 19:35:59.117892 18059 raft_consensus.cc:2229] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:35:59.118585 18059 raft_consensus.cc:2258] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:35:59.123023 18059 ts_tablet_manager.cc:1905] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:35:59.124459 18058 ts_tablet_manager.cc:1918] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:59.124696 18058 log.cc:1196] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/3690adaa0f724e3db4b4d08affef720b
I20260923 19:35:59.125335 18058 ts_tablet_manager.cc:1939] T 3690adaa0f724e3db4b4d08affef720b P 94f99911fda14d73aa6e96b0b3446f72: Deleting consensus metadata
I20260923 19:35:59.127542 17556 catalog_manager.cc:4841] TS 94f99911fda14d73aa6e96b0b3446f72 (127.12.159.195:43615): tablet 3690adaa0f724e3db4b4d08affef720b (table test-table [id=44ab036e89334cdc8575f304ee795263]) successfully deleted
I20260923 19:35:59.132674 18059 ts_tablet_manager.cc:1918] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:35:59.132948 18059 log.cc:1196] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/3690adaa0f724e3db4b4d08affef720b
I20260923 19:35:59.133585 18059 ts_tablet_manager.cc:1939] T 3690adaa0f724e3db4b4d08affef720b P 6b4e177e58c54596a9e5e3c6d4cba520: Deleting consensus metadata
I20260923 19:35:59.135669 17554 catalog_manager.cc:4841] TS 6b4e177e58c54596a9e5e3c6d4cba520 (127.12.159.194:35307): tablet 3690adaa0f724e3db4b4d08affef720b (table test-table [id=44ab036e89334cdc8575f304ee795263]) successfully deleted
I20260923 19:35:59.211215 18060 tablet_replica.cc:330] T 3690adaa0f724e3db4b4d08affef720b P ac0504ab619848deb4ba85a8587a73b4: stopping tablet replica
I20260923 19:35:59.211504 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17629
W20260923 19:35:59.230006 17557 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.159.193:41483 (error 108)
I20260923 19:35:59.230146 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17760
I20260923 19:35:59.232126 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.231609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40650)
0923 19:35:59.231807 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:59.231942 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260923 19:35:59.232403 17557 catalog_manager.cc:4584] TS ac0504ab619848deb4ba85a8587a73b4 (127.12.159.193:41483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3690adaa0f724e3db4b4d08affef720b: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
I20260923 19:35:59.234036 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.231274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41664 (local address 127.12.159.194:35307)
0923 19:35:59.231522 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:59.231526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:59.231542 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:35:59.231620 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:59.231624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:59.231727 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:59.231827 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:59.233205 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:59.233210 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:59.233214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:59.233230 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:59.233261 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:59.233274 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:59.233401 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:59.233575 (+ 174us) server_negotiation.cc:299] Negotiation successful
0923 19:35:59.233632 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:35:59.234860 17882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:59.286099 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.285489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40658)
0923 19:35:59.285734 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:59.285892 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260923 19:35:59.287400 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.286982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40670)
0923 19:35:59.287153 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:59.287255 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:35:59.346184 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17760
I20260923 19:35:59.348184 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.347568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40682)
0923 19:35:59.347828 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:59.347962 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260923 19:35:59.349376 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.348898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40692)
0923 19:35:59.349079 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:59.349215 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 19:35:59.365322 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17890
I20260923 19:35:59.368098 18031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.366192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57250 (local address 127.12.159.195:43615)
0923 19:35:59.366356 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 19:35:59.366360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:35:59.366378 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:35:59.366502 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:35:59.366506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:35:59.366590 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:35:59.366756 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:35:59.367544 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:35:59.367548 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:35:59.367551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:35:59.367564 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:35:59.367593 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:35:59.367605 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:35:59.367713 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 19:35:59.367844 (+ 131us) server_negotiation.cc:299] Negotiation successful
0923 19:35:59.367888 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:35:59.368736 18012 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:59.430550 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.430064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40694)
0923 19:35:59.430276 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:59.430387 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 19:35:59.431619 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:35:59.431216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41483 (local address 127.0.0.1:40708)
0923 19:35:59.431431 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0923 19:35:59.431500 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260923 19:35:59.458962 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17890
I20260923 19:35:59.475327 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 17539
I20260923 19:35:59.476536 17600 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:35:59.584040 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 17539
2026-09-23T19:35:59Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2622 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260923 19:35:59.625784 12927 mini_oidc.cc:152] Starting JWKS server
I20260923 19:35:59.628500 12927 webserver.cc:460] Webserver started at https://127.0.0.1:38423/ using document root <none> and password file <none>
I20260923 19:35:59.628829 12927 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 19:35:59.629514 12927 webserver.cc:460] Webserver started at http://127.0.0.1:37509/ using document root <none> and password file <none>
2026-09-23T19:35:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:35:59Z Disabled control of system clock
I20260923 19:35:59.656222 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34753
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:38259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:34753
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38423/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/testchainca.cert with env {}
W20260923 19:35:59.978336 18072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:35:59.978649 18072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:35:59.978740 18072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:35:59.986073 18072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:35:59.986182 18072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:35:59.986223 18072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:35:59.986286 18072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:35:59.986331 18072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:35:59.986397 18072 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:35:59.986438 18072 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38423/jwks.json
I20260923 19:35:59.996693 18072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:34753
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38423/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:35:59.998118 18072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:35:59.999398 18072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:00.011999 18077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:00.011977 18080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:00.011953 18078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:00.012750 18072 server_base.cc:1034] running on GCE node
I20260923 19:36:00.013695 18072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:00.015262 18072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:00.016515 18072 hybrid_clock.cc:648] HybridClock initialized: now 1790192160016464 us; error 45 us; skew 500 ppm
I20260923 19:36:00.016896 18072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:00.019372 18072 webserver.cc:460] Webserver started at http://127.12.159.254:35363/ using document root <none> and password file <none>
I20260923 19:36:00.020094 18072 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:00.020233 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:00.020545 18072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:00.023594 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42"
format_stamp: "Formatted at 2026-09-23 19:36:00 on dist-test-slave-lzv7"
server_key: "cc13208f6d28220a769722a870cac763"
server_key_iv: "af3299c54db6357083fb11bdeaff89bd"
server_key_version: "encryptionkey@0"
I20260923 19:36:00.024423 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42"
format_stamp: "Formatted at 2026-09-23 19:36:00 on dist-test-slave-lzv7"
server_key: "cc13208f6d28220a769722a870cac763"
server_key_iv: "af3299c54db6357083fb11bdeaff89bd"
server_key_version: "encryptionkey@0"
I20260923 19:36:00.030192 18072 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:36:00.034052 18086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:00.035503 18072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:36:00.035804 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42"
format_stamp: "Formatted at 2026-09-23 19:36:00 on dist-test-slave-lzv7"
server_key: "cc13208f6d28220a769722a870cac763"
server_key_iv: "af3299c54db6357083fb11bdeaff89bd"
server_key_version: "encryptionkey@0"
I20260923 19:36:00.036041 18072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:00.059816 18072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:00.060760 18072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:00.061118 18072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:00.080317 18072 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:34753
I20260923 19:36:00.080330 18137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:34753 every 8 connection(s)
I20260923 19:36:00.081722 18072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:00.085266 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18072
I20260923 19:36:00.085505 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:00.085728 18138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:00.086277 12927 external_mini_cluster.cc:1428] Setting key e6390aa5470208205cbd08825ae0ed49
I20260923 19:36:00.099575 18138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42: Bootstrap starting.
I20260923 19:36:00.101039 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:00.088241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51584 (local address 127.12.159.254:34753)
0923 19:36:00.089359 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:00.089372 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:00.089419 (+ 47us) server_negotiation.cc:407] Connection header received
0923 19:36:00.091719 (+ 2300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:00.091742 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:00.092245 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:00.092594 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:00.093258 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.094649 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.096588 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.097277 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.097415 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:00.098685 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:00.098693 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:00.098707 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:00.099284 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:00.099364 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:00.099384 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:00.099476 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:00.099770 (+ 294us) server_negotiation.cc:299] Negotiation successful
0923 19:36:00.100086 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":400,"threads_started":1}
I20260923 19:36:00.102975 18138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:00.104151 18138 log.cc:824] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:00.104806 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:36:00.106935 18138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42: No bootstrap required, opened a new log
I20260923 19:36:00.114720 18138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34753 } }
I20260923 19:36:00.115151 18138 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:00.115260 18138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fb77f1fad6442629d3ee9bbe8ae3f42, State: Initialized, Role: FOLLOWER
I20260923 19:36:00.115831 18138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34753 } }
I20260923 19:36:00.116070 18138 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:00.116219 18138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:00.116394 18138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:00.118662 18138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34753 } }
I20260923 19:36:00.119220 18138 leader_election.cc:302] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fb77f1fad6442629d3ee9bbe8ae3f42; no voters:
I20260923 19:36:00.119815 18138 leader_election.cc:288] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:00.120043 18143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:00.121409 18143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [term 1 LEADER]: Becoming Leader. State: Replica: 0fb77f1fad6442629d3ee9bbe8ae3f42, State: Running, Role: LEADER
I20260923 19:36:00.122013 18143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34753 } }
I20260923 19:36:00.122172 18138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:00.125097 18144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34753 } } }
I20260923 19:36:00.125535 18144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:00.125072 18145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fb77f1fad6442629d3ee9bbe8ae3f42. Latest consensus state: current_term: 1 leader_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fb77f1fad6442629d3ee9bbe8ae3f42" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34753 } } }
I20260923 19:36:00.126981 18145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:00.128609 18150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:00.134426 18150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:00.143321 18150 catalog_manager.cc:1347] Generated new cluster ID: 25499ef5a48c447bbc18026df36c595b
I20260923 19:36:00.143442 18150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:00.165009 18150 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:00.166555 18150 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:00.175279 18150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fb77f1fad6442629d3ee9bbe8ae3f42: Generated new TSK 0
I20260923 19:36:00.176216 18150 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 19:36:00.222728 18168 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260923 19:36:00.222908 18168 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 19:36:00.224079 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:00.201440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51592 (local address 127.12.159.254:34753)
0923 19:36:00.201642 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:00.201649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:00.202206 (+ 557us) server_negotiation.cc:407] Connection header received
0923 19:36:00.202492 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:00.202498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:00.202592 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:00.202754 (+ 162us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:36:00.203259 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.204428 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.206353 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.207103 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.207245 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:00.207771 (+ 526us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:36:00.223372 (+ 15601us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 19:36:00.223758 (+ 386us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51592: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":65}
W20260923 19:36:00.224200 18141 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51592: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260923 19:36:00.225715 18167 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:00.201409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34753 (local address 127.0.0.1:51592)
0923 19:36:00.202107 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:00.202123 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:00.202270 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:00.202778 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:00.202782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:00.202791 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:36:00.203120 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:00.203127 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.204579 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.204583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:00.206208 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:00.206221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.207292 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.207296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:00.207426 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:00.207484 (+ 58us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:36:00.223791 (+ 16307us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 19:36:00.224102 (+ 311us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.159.254:34753: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":347,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.159.254:34753: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260923 19:36:00.228029 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18072
I20260923 19:36:00.229343 18133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:00.326654 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18072
2026-09-23T19:36:00Z chronyd exiting
I20260923 19:36:00.377362 12927 test_util.cc:175] -----------------------------------------------
I20260923 19:36:00.377547 12927 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192117815085-12927-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (756 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260923 19:36:00.381219 12927 mini_oidc.cc:152] Starting JWKS server
I20260923 19:36:00.383157 12927 webserver.cc:460] Webserver started at https://127.0.0.1:33017/ using document root <none> and password file <none>
I20260923 19:36:00.383405 12927 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 19:36:00.384055 12927 webserver.cc:460] Webserver started at http://127.0.0.1:40089/ using document root <none> and password file <none>
2026-09-23T19:36:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:00Z Disabled control of system clock
I20260923 19:36:00.411628 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38257
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:33381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:38257
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33017/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/testchainca.cert with env {}
W20260923 19:36:00.742408 18175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:00.742764 18175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:00.742923 18175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:00.750255 18175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:00.750416 18175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:00.750514 18175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:00.750605 18175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:00.750676 18175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:36:00.750767 18175 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:36:00.750849 18175 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33017/jwks.json
I20260923 19:36:00.761315 18175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:33381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:38257
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33017/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:00.762708 18175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:00.764030 18175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:00.778231 18180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:00.778210 18183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:00.778177 18181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:00.779095 18175 server_base.cc:1034] running on GCE node
I20260923 19:36:00.779860 18175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:00.781334 18175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:00.782574 18175 hybrid_clock.cc:648] HybridClock initialized: now 1790192160782530 us; error 54 us; skew 500 ppm
I20260923 19:36:00.782948 18175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:00.785238 18175 webserver.cc:460] Webserver started at http://127.12.159.254:40443/ using document root <none> and password file <none>
I20260923 19:36:00.786013 18175 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:00.786161 18175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:00.786490 18175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:00.789407 18175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "cb17bf3cfc6748638bd239dbdec1bb25"
format_stamp: "Formatted at 2026-09-23 19:36:00 on dist-test-slave-lzv7"
server_key: "a7de8fe561c299d67f215387f2171ada"
server_key_iv: "ccc01f0d917f0b78bf36cb592ec8c4ef"
server_key_version: "encryptionkey@0"
I20260923 19:36:00.790261 18175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "cb17bf3cfc6748638bd239dbdec1bb25"
format_stamp: "Formatted at 2026-09-23 19:36:00 on dist-test-slave-lzv7"
server_key: "a7de8fe561c299d67f215387f2171ada"
server_key_iv: "ccc01f0d917f0b78bf36cb592ec8c4ef"
server_key_version: "encryptionkey@0"
I20260923 19:36:00.795632 18175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:36:00.799166 18189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:00.800575 18175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:36:00.800760 18175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "cb17bf3cfc6748638bd239dbdec1bb25"
format_stamp: "Formatted at 2026-09-23 19:36:00 on dist-test-slave-lzv7"
server_key: "a7de8fe561c299d67f215387f2171ada"
server_key_iv: "ccc01f0d917f0b78bf36cb592ec8c4ef"
server_key_version: "encryptionkey@0"
I20260923 19:36:00.801014 18175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:00.837766 18175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:00.838798 18175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:00.839147 18175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:00.857913 18175 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:38257
I20260923 19:36:00.857963 18240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:38257 every 8 connection(s)
I20260923 19:36:00.859318 18175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:00.862023 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18175
I20260923 19:36:00.862205 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:00.862836 12927 external_mini_cluster.cc:1428] Setting key 8df4a5cf4be8b3fc550b79add83d30f0
I20260923 19:36:00.863260 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:00.875859 18241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25: Bootstrap starting.
I20260923 19:36:00.876674 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:00.864706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34332 (local address 127.12.159.254:38257)
0923 19:36:00.865706 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:00.865717 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:00.865759 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:36:00.867920 (+ 2161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:00.867942 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:00.868429 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:00.868856 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:00.869465 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.870830 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.872139 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.872818 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.873145 (+ 327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:00.874352 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:00.874360 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:00.874374 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:00.874900 (+ 526us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:00.875001 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:00.875022 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:00.875149 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:00.875372 (+ 223us) server_negotiation.cc:299] Negotiation successful
0923 19:36:00.875677 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":349,"threads_started":1}
I20260923 19:36:00.879380 18241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:00.880548 18241 log.cc:824] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:00.880573 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:36:00.883529 18241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25: No bootstrap required, opened a new log
I20260923 19:36:00.890648 18241 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38257 } }
I20260923 19:36:00.890995 18241 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:00.891119 18241 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb17bf3cfc6748638bd239dbdec1bb25, State: Initialized, Role: FOLLOWER
I20260923 19:36:00.891760 18241 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38257 } }
I20260923 19:36:00.891954 18241 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:00.892119 18241 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:00.892279 18241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:00.894461 18241 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38257 } }
I20260923 19:36:00.894956 18241 leader_election.cc:302] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb17bf3cfc6748638bd239dbdec1bb25; no voters:
I20260923 19:36:00.895749 18246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:00.896148 18241 leader_election.cc:288] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:00.897092 18246 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [term 1 LEADER]: Becoming Leader. State: Replica: cb17bf3cfc6748638bd239dbdec1bb25, State: Running, Role: LEADER
I20260923 19:36:00.897652 18246 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38257 } }
I20260923 19:36:00.898491 18241 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:00.900415 18247 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38257 } } }
I20260923 19:36:00.900406 18248 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb17bf3cfc6748638bd239dbdec1bb25. Latest consensus state: current_term: 1 leader_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb17bf3cfc6748638bd239dbdec1bb25" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38257 } } }
I20260923 19:36:00.900851 18247 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:00.900851 18248 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:00.902179 18252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:00.913321 18252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:00.923084 18252 catalog_manager.cc:1347] Generated new cluster ID: 8e5bc25a2cf945b2897c5447f79d8d61
I20260923 19:36:00.923208 18252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:00.936774 18252 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:00.938632 18252 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:00.951491 18252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb17bf3cfc6748638bd239dbdec1bb25: Generated new TSK 0
I20260923 19:36:00.952562 18252 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 19:36:00.993752 18271 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260923 19:36:00.993963 18271 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 19:36:00.995229 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:00.974483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.12.159.254:38257)
0923 19:36:00.974724 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:00.974731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:00.975167 (+ 436us) server_negotiation.cc:407] Connection header received
0923 19:36:00.975378 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:00.975384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:00.975483 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:00.975650 (+ 167us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:36:00.976152 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.977292 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.978859 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.979549 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.979725 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:00.980214 (+ 489us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:36:00.994483 (+ 14269us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33017/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 19:36:00.994882 (+ 399us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34334: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33017/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":69}
W20260923 19:36:00.995357 18244 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34334: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33017/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260923 19:36:00.995419 18270 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:00.974315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38257 (local address 127.0.0.1:34334)
0923 19:36:00.975047 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:00.975069 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:00.975208 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:00.975680 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:00.975685 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:00.975695 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:36:00.975950 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:00.975960 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.977476 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.977481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:00.978714 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:00.978727 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:00.979746 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:00.979751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:00.979905 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:00.979944 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:36:00.994760 (+ 14816us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33017/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 19:36:00.994975 (+ 215us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.159.254:38257: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33017/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":436,"threads_started":1}
I20260923 19:36:00.997107 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18175
I20260923 19:36:00.998436 18236 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:01.095300 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18175
2026-09-23T19:36:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (770 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260923 19:36:01.151695 12927 mini_oidc.cc:152] Starting JWKS server
I20260923 19:36:01.153779 12927 webserver.cc:460] Webserver started at https://127.0.0.1:45085/ using document root <none> and password file <none>
I20260923 19:36:01.154122 12927 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 19:36:01.154897 12927 webserver.cc:460] Webserver started at http://127.0.0.1:34233/ using document root <none> and password file <none>
2026-09-23T19:36:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:01Z Disabled control of system clock
I20260923 19:36:01.182889 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41221
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:40607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:41221
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45085/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 19:36:01.514328 18278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:01.514626 18278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:01.514730 18278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:01.522154 18278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:01.522264 18278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:01.522300 18278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:01.522349 18278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:01.522393 18278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:36:01.522449 18278 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:36:01.522498 18278 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45085/jwks.json
I20260923 19:36:01.531885 18278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:41221
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45085/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:01.533253 18278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:01.535050 18278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:01.546808 18286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:01.546912 18284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:01.546912 18283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:01.547998 18278 server_base.cc:1034] running on GCE node
I20260923 19:36:01.548787 18278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:01.550477 18278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:01.551757 18278 hybrid_clock.cc:648] HybridClock initialized: now 1790192161551691 us; error 59 us; skew 500 ppm
I20260923 19:36:01.552150 18278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:01.554569 18278 webserver.cc:460] Webserver started at http://127.12.159.254:33965/ using document root <none> and password file <none>
I20260923 19:36:01.555663 18278 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:01.555801 18278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:01.556177 18278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:01.559333 18278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "f0856563ab3b4eaf941c7e2a349e19ae"
format_stamp: "Formatted at 2026-09-23 19:36:01 on dist-test-slave-lzv7"
server_key: "c875fdeef1eed155c0ce8da02553e5f3"
server_key_iv: "b1fcce7da758a59dddb315cfc092a2d2"
server_key_version: "encryptionkey@0"
I20260923 19:36:01.560276 18278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "f0856563ab3b4eaf941c7e2a349e19ae"
format_stamp: "Formatted at 2026-09-23 19:36:01 on dist-test-slave-lzv7"
server_key: "c875fdeef1eed155c0ce8da02553e5f3"
server_key_iv: "b1fcce7da758a59dddb315cfc092a2d2"
server_key_version: "encryptionkey@0"
I20260923 19:36:01.565990 18278 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:36:01.569674 18292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:01.571164 18278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:36:01.571357 18278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "f0856563ab3b4eaf941c7e2a349e19ae"
format_stamp: "Formatted at 2026-09-23 19:36:01 on dist-test-slave-lzv7"
server_key: "c875fdeef1eed155c0ce8da02553e5f3"
server_key_iv: "b1fcce7da758a59dddb315cfc092a2d2"
server_key_version: "encryptionkey@0"
I20260923 19:36:01.571589 18278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:01.599282 18278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:01.600188 18278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:01.600529 18278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:01.619630 18278 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:41221
I20260923 19:36:01.619637 18343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:41221 every 8 connection(s)
I20260923 19:36:01.621156 18278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:01.623333 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18278
I20260923 19:36:01.623600 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:01.624390 12927 external_mini_cluster.cc:1428] Setting key e25fd7c4dbc4fb7feae4a78a0f79cfd9
I20260923 19:36:01.626245 18344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:01.638968 18347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:01.626540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51946 (local address 127.12.159.254:41221)
0923 19:36:01.627558 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:01.627569 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:01.627611 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:36:01.629203 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:01.629229 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:01.629730 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:01.630179 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:01.630731 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:01.632603 (+ 1872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:01.634483 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:01.635123 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:01.635290 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:01.636471 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:01.636478 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:01.636492 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:01.637062 (+ 570us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:01.637166 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:01.637192 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:01.637320 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:01.637544 (+ 224us) server_negotiation.cc:299] Negotiation successful
0923 19:36:01.637974 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":381,"threads_started":1}
I20260923 19:36:01.640146 18344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae: Bootstrap starting.
I20260923 19:36:01.643064 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:36:01.643750 18344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:01.644786 18344 log.cc:824] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:01.649628 18344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae: No bootstrap required, opened a new log
I20260923 19:36:01.659235 18344 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41221 } }
I20260923 19:36:01.659670 18344 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:01.659757 18344 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0856563ab3b4eaf941c7e2a349e19ae, State: Initialized, Role: FOLLOWER
I20260923 19:36:01.660394 18344 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41221 } }
I20260923 19:36:01.660633 18344 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:01.660750 18344 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:01.660890 18344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:01.664160 18344 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41221 } }
I20260923 19:36:01.664691 18344 leader_election.cc:302] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0856563ab3b4eaf941c7e2a349e19ae; no voters:
I20260923 19:36:01.665267 18344 leader_election.cc:288] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:01.665452 18349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:01.666217 18349 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [term 1 LEADER]: Becoming Leader. State: Replica: f0856563ab3b4eaf941c7e2a349e19ae, State: Running, Role: LEADER
I20260923 19:36:01.666785 18349 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41221 } }
I20260923 19:36:01.667580 18344 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:01.669965 18350 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41221 } } }
I20260923 19:36:01.670540 18350 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:01.670703 18351 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0856563ab3b4eaf941c7e2a349e19ae. Latest consensus state: current_term: 1 leader_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0856563ab3b4eaf941c7e2a349e19ae" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41221 } } }
I20260923 19:36:01.671051 18351 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:01.672884 18355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:01.678507 18355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:01.688009 18355 catalog_manager.cc:1347] Generated new cluster ID: b95f4ba023764b7c869673ae668bf765
I20260923 19:36:01.688145 18355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:01.707940 18355 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:01.709339 18355 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:01.738303 18355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0856563ab3b4eaf941c7e2a349e19ae: Generated new TSK 0
I20260923 19:36:01.739236 18355 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:36:01.770088 18347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:01.761358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.12.159.254:41221)
0923 19:36:01.761598 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:01.761608 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:01.762075 (+ 467us) server_negotiation.cc:407] Connection header received
0923 19:36:01.762366 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:01.762370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:01.762446 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:01.762581 (+ 135us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:36:01.763145 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:01.763915 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:01.765967 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:01.766485 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:01.766580 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:01.767306 (+ 726us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:36:01.769398 (+ 2092us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45085/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 19:36:01.769738 (+ 340us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51962: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45085/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":72}
W20260923 19:36:01.770237 18347 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51962: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45085/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260923 19:36:01.770363 18373 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:01.761305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41221 (local address 127.0.0.1:51962)
0923 19:36:01.761960 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:01.761982 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:01.762143 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:01.762629 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:01.762636 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:01.762649 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:36:01.762982 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:01.762995 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:01.764073 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:01.764078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:01.765783 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:01.765798 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:01.766685 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:01.766694 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:01.766904 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:01.766954 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:36:01.769616 (+ 2662us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45085/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 19:36:01.769916 (+ 300us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.159.254:41221: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45085/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":338,"threads_started":1}
I20260923 19:36:01.771379 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18278
I20260923 19:36:01.772554 18339 generic_service.cc:196] Checking for leaks (request via RPC)
E20260923 19:36:01.782917 18374 webserver.cc:533] Webserver: sslize failed:
E20260923 19:36:01.783063 18374 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 19:36:01.868813 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18278
2026-09-23T19:36:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (773 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-23T19:36:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:01Z Disabled control of system clock
I20260923 19:36:01.954706 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34755
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:39951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:34755
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/testchainca.cert with env {}
W20260923 19:36:02.290917 18379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:02.291258 18379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:02.291503 18379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:02.298962 18379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:02.299078 18379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:02.299157 18379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:02.299266 18379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:02.299373 18379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:36:02.299482 18379 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:36:02.299563 18379 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260923 19:36:02.309847 18379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:39951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:34755
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:02.311223 18379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:02.312597 18379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:02.325161 18384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:02.325263 18385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:02.325213 18387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:02.326683 18379 server_base.cc:1034] running on GCE node
I20260923 19:36:02.327658 18379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:02.329207 18379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:02.330463 18379 hybrid_clock.cc:648] HybridClock initialized: now 1790192162330411 us; error 41 us; skew 500 ppm
I20260923 19:36:02.330930 18379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:02.333931 18379 webserver.cc:460] Webserver started at http://127.12.159.254:45557/ using document root <none> and password file <none>
I20260923 19:36:02.334748 18379 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:02.334860 18379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:02.335201 18379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:02.338426 18379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd"
format_stamp: "Formatted at 2026-09-23 19:36:02 on dist-test-slave-lzv7"
server_key: "9d1801a52bbb7a3a721f3dccdf2d5b5e"
server_key_iv: "8da1dcede2b85de90cd1d72b65f963d8"
server_key_version: "encryptionkey@0"
I20260923 19:36:02.339277 18379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd"
format_stamp: "Formatted at 2026-09-23 19:36:02 on dist-test-slave-lzv7"
server_key: "9d1801a52bbb7a3a721f3dccdf2d5b5e"
server_key_iv: "8da1dcede2b85de90cd1d72b65f963d8"
server_key_version: "encryptionkey@0"
I20260923 19:36:02.345152 18379 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260923 19:36:02.349023 18393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:02.350637 18379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:02.350868 18379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd"
format_stamp: "Formatted at 2026-09-23 19:36:02 on dist-test-slave-lzv7"
server_key: "9d1801a52bbb7a3a721f3dccdf2d5b5e"
server_key_iv: "8da1dcede2b85de90cd1d72b65f963d8"
server_key_version: "encryptionkey@0"
I20260923 19:36:02.351082 18379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:02.371140 18379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:02.372042 18379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:02.372340 18379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:02.391819 18379 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:34755
I20260923 19:36:02.391855 18444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:34755 every 8 connection(s)
I20260923 19:36:02.393240 18379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:02.395772 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18379
I20260923 19:36:02.395988 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:02.396646 12927 external_mini_cluster.cc:1428] Setting key b7322b8f01915010583517e6f5077174
I20260923 19:36:02.397866 18445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:02.411212 18445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd: Bootstrap starting.
I20260923 19:36:02.414660 18445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:02.415930 18445 log.cc:824] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:02.417732 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:02.398618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36678 (local address 127.12.159.254:34755)
0923 19:36:02.399622 (+ 1004us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:02.399633 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:02.399674 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:36:02.401243 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:02.401265 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:02.401760 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:02.402277 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:02.402862 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:02.404268 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:02.405726 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:02.406510 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:02.406715 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:02.414715 (+ 8000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:02.414725 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:02.414764 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:02.415466 (+ 702us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:02.415570 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:02.415593 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:02.415766 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:02.416030 (+ 264us) server_negotiation.cc:299] Negotiation successful
0923 19:36:02.416411 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":329,"threads_started":1}
I20260923 19:36:02.419567 18445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd: No bootstrap required, opened a new log
I20260923 19:36:02.422235 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:36:02.428272 18445 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34755 } }
I20260923 19:36:02.428699 18445 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:02.428848 18445 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2ff87673ee4bc5b38ddc3eda86f4fd, State: Initialized, Role: FOLLOWER
I20260923 19:36:02.429477 18445 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34755 } }
I20260923 19:36:02.429735 18445 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:02.429910 18445 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:02.430099 18445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:02.432256 18445 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34755 } }
I20260923 19:36:02.432900 18445 leader_election.cc:302] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa2ff87673ee4bc5b38ddc3eda86f4fd; no voters:
I20260923 19:36:02.433700 18445 leader_election.cc:288] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:02.433885 18450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:02.434715 18450 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [term 1 LEADER]: Becoming Leader. State: Replica: fa2ff87673ee4bc5b38ddc3eda86f4fd, State: Running, Role: LEADER
I20260923 19:36:02.435345 18450 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34755 } }
I20260923 19:36:02.436061 18445 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:02.439435 18452 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa2ff87673ee4bc5b38ddc3eda86f4fd. Latest consensus state: current_term: 1 leader_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34755 } } }
I20260923 19:36:02.439469 18451 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2ff87673ee4bc5b38ddc3eda86f4fd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34755 } } }
I20260923 19:36:02.439862 18452 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:02.439918 18451 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:02.442162 18457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:02.449186 18457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:02.460462 18457 catalog_manager.cc:1347] Generated new cluster ID: 3ea9bac36821471484739ab54527e79e
I20260923 19:36:02.460608 18457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:02.481943 18457 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:02.483434 18457 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:02.495069 18457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa2ff87673ee4bc5b38ddc3eda86f4fd: Generated new TSK 0
I20260923 19:36:02.496109 18457 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:36:02.604169 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:02.517579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36694 (local address 127.12.159.254:34755)
0923 19:36:02.517890 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:02.517900 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:02.518392 (+ 492us) server_negotiation.cc:407] Connection header received
0923 19:36:02.518635 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:02.518646 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:02.518786 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:02.518989 (+ 203us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:36:02.519527 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:02.520276 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:02.522469 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:02.523355 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:02.523510 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:02.524236 (+ 726us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:36:02.603587 (+ 79351us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 19:36:02.603931 (+ 344us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36694: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":82}
W20260923 19:36:02.604339 18448 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36694: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260923 19:36:02.604667 18474 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:02.517478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34755 (local address 127.0.0.1:36694)
0923 19:36:02.518227 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:02.518249 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:02.518414 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:02.519015 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:02.519020 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:02.519034 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:36:02.519339 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:02.519350 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:02.520459 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:02.520465 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:02.522261 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:02.522278 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:02.523588 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:02.523596 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:02.523801 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:02.523866 (+ 65us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:36:02.603898 (+ 80032us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 19:36:02.604227 (+ 329us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.159.254:34755: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":406,"threads_started":1}
I20260923 19:36:02.605800 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18379
I20260923 19:36:02.607187 18440 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:02.714067 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18379
2026-09-23T19:36:02Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (824 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (428 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (420 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:36:03 dist-test-slave-lzv7 krb5kdc[18489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:36:03 dist-test-slave-lzv7 krb5kdc[18489](info): set up 2 sockets
Sep 23 19:36:03 dist-test-slave-lzv7 krb5kdc[18489](info): commencing operation
krb5kdc: starting...
W20260923 19:36:04.670575 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:36:04 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:36:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:36:04.887470 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45297
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45297
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:05.210597 18502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:05.210912 18502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:05.211090 18502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:05.218429 18502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:05.218544 18502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:05.218645 18502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:05.218736 18502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:05.218825 18502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:05.228788 18502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:05.230188 18502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:05.231540 18502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:05.244249 18507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:05.244025 18508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:05.244025 18510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:05.245481 18502 server_base.cc:1034] running on GCE node
I20260923 19:36:05.246349 18502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:05.247833 18502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:05.249049 18502 hybrid_clock.cc:648] HybridClock initialized: now 1790192165249004 us; error 41 us; skew 500 ppm
I20260923 19:36:05.249362 18502 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:05 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192165, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:05.252620 18502 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:36:05.254263 18502 webserver.cc:460] Webserver started at http://127.12.159.254:40127/ using document root <none> and password file <none>
I20260923 19:36:05.254984 18502 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:05.255120 18502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:05.255450 18502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:05.258493 18502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "ebc807d2bc814b8d9b56c485907a9d0f"
format_stamp: "Formatted at 2026-09-23 19:36:05 on dist-test-slave-lzv7"
server_key: "b14ef5cdb2bbd02b492411002f25d840"
server_key_iv: "d9a844c17829df55683c9d9b876ec72a"
server_key_version: "encryptionkey@0"
I20260923 19:36:05.259294 18502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "ebc807d2bc814b8d9b56c485907a9d0f"
format_stamp: "Formatted at 2026-09-23 19:36:05 on dist-test-slave-lzv7"
server_key: "b14ef5cdb2bbd02b492411002f25d840"
server_key_iv: "d9a844c17829df55683c9d9b876ec72a"
server_key_version: "encryptionkey@0"
I20260923 19:36:05.264500 18502 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260923 19:36:05.268075 18517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:05.269493 18502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:36:05.269695 18502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "ebc807d2bc814b8d9b56c485907a9d0f"
format_stamp: "Formatted at 2026-09-23 19:36:05 on dist-test-slave-lzv7"
server_key: "b14ef5cdb2bbd02b492411002f25d840"
server_key_iv: "d9a844c17829df55683c9d9b876ec72a"
server_key_version: "encryptionkey@0"
I20260923 19:36:05.269973 18502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:05.303862 18502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:05.308446 18502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:05.308753 18502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:05.327991 18502 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45297
I20260923 19:36:05.328035 18568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45297 every 8 connection(s)
I20260923 19:36:05.329382 18502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:05.333158 18569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:05.337944 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18502
I20260923 19:36:05.338147 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:05.338786 12927 external_mini_cluster.cc:1428] Setting key 9b64dfe79891fa01630e3b2a050ff26a
I20260923 19:36:05.344151 18569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f: Bootstrap starting.
I20260923 19:36:05.348018 18569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:05.349318 18569 log.cc:824] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:05.352211 18569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f: No bootstrap required, opened a new log
Sep 23 19:36:05 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:05.360507 18569 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45297 } }
I20260923 19:36:05.360911 18569 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:05.361050 18569 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc807d2bc814b8d9b56c485907a9d0f, State: Initialized, Role: FOLLOWER
I20260923 19:36:05.361661 18569 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45297 } }
I20260923 19:36:05.361970 18569 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:05.362119 18569 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:05.362299 18569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:05.362491 18572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:05.341062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58148 (local address 127.12.159.254:45297)
0923 19:36:05.341967 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:05.341979 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:05.342021 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:36:05.343703 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:05.343726 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:05.344120 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:05.344508 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:05.346313 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:05.347657 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:05.349561 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:05.350402 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:05.350637 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:05.354777 (+ 4140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:05.354787 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:05.354802 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:05.354854 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:05.358105 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:05.358797 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:05.358810 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:05.358816 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:05.358985 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:05.359383 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:05.359389 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:05.359392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:05.359949 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:05.360251 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:05.360704 (+ 453us) server_negotiation.cc:299] Negotiation successful
0923 19:36:05.361187 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":446,"threads_started":1}
I20260923 19:36:05.364658 18569 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45297 } }
I20260923 19:36:05.365233 18569 leader_election.cc:302] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebc807d2bc814b8d9b56c485907a9d0f; no voters:
I20260923 19:36:05.365859 18569 leader_election.cc:288] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:05.366078 18574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:05.366796 18574 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [term 1 LEADER]: Becoming Leader. State: Replica: ebc807d2bc814b8d9b56c485907a9d0f, State: Running, Role: LEADER
I20260923 19:36:05.367313 18574 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45297 } }
I20260923 19:36:05.367950 18569 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:05.369895 18575 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45297 } } }
I20260923 19:36:05.370054 18576 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebc807d2bc814b8d9b56c485907a9d0f. Latest consensus state: current_term: 1 leader_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebc807d2bc814b8d9b56c485907a9d0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45297 } } }
I20260923 19:36:05.370317 18575 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:05.370317 18576 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:05.372025 18579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:05.381333 18579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:05.390107 18579 catalog_manager.cc:1347] Generated new cluster ID: 44587105eb8f42309601f03bca44f909
I20260923 19:36:05.390234 18579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:05.401093 18579 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:05.402956 18579 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:05.409214 18579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebc807d2bc814b8d9b56c485907a9d0f: Generated new TSK 0
I20260923 19:36:05.410260 18579 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:36:05.466073 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45297
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:05.810824 18595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:05.811136 18595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:05.811304 18595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:05.818954 18595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:05.819084 18595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:05.819270 18595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:05.829310 18595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45297
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:05.830729 18595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:05.832065 18595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:05.845609 18603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:05.845638 18601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:05.845670 18600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:05.846465 18595 server_base.cc:1034] running on GCE node
I20260923 19:36:05.847021 18595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:05.847908 18595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:05.849149 18595 hybrid_clock.cc:648] HybridClock initialized: now 1790192165849089 us; error 74 us; skew 500 ppm
I20260923 19:36:05.849474 18595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:05 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192165, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:05.852754 18595 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:36:05.854408 18595 webserver.cc:460] Webserver started at http://127.12.159.193:38297/ using document root <none> and password file <none>
I20260923 19:36:05.855263 18595 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:05.855412 18595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:05.855732 18595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:05.858875 18595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "adc93035222a4da8a8959d86d0e4883d"
format_stamp: "Formatted at 2026-09-23 19:36:05 on dist-test-slave-lzv7"
server_key: "3514d48d179a4c953ffb7efd9149ca2f"
server_key_iv: "5b8d3ddc23e8af268f413540cc059111"
server_key_version: "encryptionkey@0"
I20260923 19:36:05.859722 18595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "adc93035222a4da8a8959d86d0e4883d"
format_stamp: "Formatted at 2026-09-23 19:36:05 on dist-test-slave-lzv7"
server_key: "3514d48d179a4c953ffb7efd9149ca2f"
server_key_iv: "5b8d3ddc23e8af268f413540cc059111"
server_key_version: "encryptionkey@0"
I20260923 19:36:05.865044 18595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:36:05.868746 18610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:05.870249 18595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:05.870421 18595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "adc93035222a4da8a8959d86d0e4883d"
format_stamp: "Formatted at 2026-09-23 19:36:05 on dist-test-slave-lzv7"
server_key: "3514d48d179a4c953ffb7efd9149ca2f"
server_key_iv: "5b8d3ddc23e8af268f413540cc059111"
server_key_version: "encryptionkey@0"
I20260923 19:36:05.870639 18595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:05.883383 18595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:05.887609 18595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:05.887918 18595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:05.888904 18595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:05.890342 18595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:05.890445 18595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:05.890588 18595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:05.890661 18595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:05.932452 18595 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:43159
I20260923 19:36:05.932508 18722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:43159 every 8 connection(s)
I20260923 19:36:05.934100 18595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:05.940405 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18595
I20260923 19:36:05.940631 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:36:05.941474 12927 external_mini_cluster.cc:1428] Setting key 1f3efea73db066bf15d154d7bb63e005
Sep 23 19:36:05 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192165, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:36:05.968950 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:05.937170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56253 (local address 127.12.159.254:45297)
0923 19:36:05.937676 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:05.937683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:05.938876 (+ 1193us) server_negotiation.cc:407] Connection header received
0923 19:36:05.941453 (+ 2577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:05.941459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:05.941553 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:05.941661 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:05.943749 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:05.944586 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:05.947250 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:05.947967 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:05.948119 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:05.954053 (+ 5934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:05.954060 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:05.954064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:05.954107 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:05.963824 (+ 9717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:05.964995 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:05.965000 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:05.965004 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:05.965181 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:05.965694 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:05.965699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:05.965702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:05.966051 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:05.966217 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:05.968315 (+ 2098us) server_negotiation.cc:299] Negotiation successful
0923 19:36:05.968552 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":248,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
I20260923 19:36:05.970165 18726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:05.937735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45297 (local address 127.12.159.193:56253)
0923 19:36:05.938699 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:05.938748 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:05.941158 (+ 2410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:05.941957 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:05.941969 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:05.942813 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:05.943485 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:05.943514 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:05.944820 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:05.944828 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:05.947084 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:05.947107 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:05.948211 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:05.948216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:05.948480 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:05.950297 (+ 1817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:05.950325 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:05.953736 (+ 3411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:05.964099 (+ 10363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:05.964109 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:05.964131 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:05.964869 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:05.965287 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:05.965291 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:05.965295 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:05.965553 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:05.966182 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:05.966191 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:05.966682 (+ 491us) client_negotiation.cc:769] Sending connection context
0923 19:36:05.967041 (+ 359us) client_negotiation.cc:240] Negotiation successful
0923 19:36:05.967685 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":334,"threads_started":1}
I20260923 19:36:05.972005 18723 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45297
I20260923 19:36:05.972466 18723 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:05.973721 18723 heartbeater.cc:511] Master 127.12.159.254:45297 requested a full tablet report, sending...
I20260923 19:36:05.976501 18534 ts_manager.cc:194] Registered new tserver with Master: adc93035222a4da8a8959d86d0e4883d (127.12.159.193:43159)
I20260923 19:36:05.978909 18534 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:56253
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:36:05.998040 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45297
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:06.321897 18729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:06.322237 18729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:06.322407 18729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:06.329640 18729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:06.329792 18729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:06.329994 18729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:06.339851 18729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45297
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:06.341174 18729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:06.342612 18729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:06.356017 18734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:06.356146 18735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:06.356675 18737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:06.356952 18729 server_base.cc:1034] running on GCE node
I20260923 19:36:06.357589 18729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:06.358590 18729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:06.359793 18729 hybrid_clock.cc:648] HybridClock initialized: now 1790192166359751 us; error 38 us; skew 500 ppm
I20260923 19:36:06.360132 18729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:06 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:06.363481 18729 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:36:06.364907 18729 webserver.cc:460] Webserver started at http://127.12.159.194:42789/ using document root <none> and password file <none>
I20260923 19:36:06.365612 18729 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:06.365715 18729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:06.366084 18729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:06.369218 18729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "746126999fd34dafb44a65da9f79ae02"
format_stamp: "Formatted at 2026-09-23 19:36:06 on dist-test-slave-lzv7"
server_key: "e35e6f042e0c5c6d4b84473a055bf5c0"
server_key_iv: "26d65fe92f999b7d875d09180d66ecbb"
server_key_version: "encryptionkey@0"
I20260923 19:36:06.370081 18729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "746126999fd34dafb44a65da9f79ae02"
format_stamp: "Formatted at 2026-09-23 19:36:06 on dist-test-slave-lzv7"
server_key: "e35e6f042e0c5c6d4b84473a055bf5c0"
server_key_iv: "26d65fe92f999b7d875d09180d66ecbb"
server_key_version: "encryptionkey@0"
I20260923 19:36:06.375712 18729 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:36:06.379346 18744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:06.380715 18729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:36:06.380893 18729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "746126999fd34dafb44a65da9f79ae02"
format_stamp: "Formatted at 2026-09-23 19:36:06 on dist-test-slave-lzv7"
server_key: "e35e6f042e0c5c6d4b84473a055bf5c0"
server_key_iv: "26d65fe92f999b7d875d09180d66ecbb"
server_key_version: "encryptionkey@0"
I20260923 19:36:06.381104 18729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:06.397236 18729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:06.401154 18729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:06.401448 18729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:06.402465 18729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:06.403883 18729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:06.403988 18729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:06.404142 18729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:06.404214 18729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:06.439534 18729 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:42921
I20260923 19:36:06.439560 18856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:42921 every 8 connection(s)
I20260923 19:36:06.440886 18729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:06.448408 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18729
I20260923 19:36:06.448606 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:36:06.449148 12927 external_mini_cluster.cc:1428] Setting key c974452e0426764761ae6d102f71dfea
Sep 23 19:36:06 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:06.463768 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:06.443834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:46677 (local address 127.12.159.254:45297)
0923 19:36:06.444023 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:06.444027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:06.445237 (+ 1210us) server_negotiation.cc:407] Connection header received
0923 19:36:06.447169 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:06.447175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:06.447275 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:06.447397 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:06.449446 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.450477 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.452768 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.453253 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.453369 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:06.457722 (+ 4353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:06.457729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:06.457732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:06.457768 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:06.460457 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:06.461286 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:06.461293 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:06.461296 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:06.461442 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:06.461946 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:06.461953 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:06.461957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:06.462253 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:06.462419 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:06.463162 (+ 743us) server_negotiation.cc:299] Negotiation successful
0923 19:36:06.463402 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:36:06.464839 18859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:06.444311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45297 (local address 127.12.159.194:46677)
0923 19:36:06.445052 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:06.445092 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:06.446885 (+ 1793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:06.447656 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:06.447664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:06.448353 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:06.449183 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:06.449220 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.450640 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.450644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:06.452603 (+ 1959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:06.452621 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.453508 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.453517 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:06.453926 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:06.454663 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:06.454698 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:06.457444 (+ 2746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:06.460634 (+ 3190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:06.460652 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:06.460670 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:06.461132 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:06.461567 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:06.461573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:06.461577 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:06.461776 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:06.462392 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:06.462401 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:06.462778 (+ 377us) client_negotiation.cc:769] Sending connection context
0923 19:36:06.463052 (+ 274us) client_negotiation.cc:240] Negotiation successful
0923 19:36:06.463633 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":290,"threads_started":1}
I20260923 19:36:06.466607 18857 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45297
I20260923 19:36:06.466948 18857 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:06.467797 18857 heartbeater.cc:511] Master 127.12.159.254:45297 requested a full tablet report, sending...
I20260923 19:36:06.469393 18534 ts_manager.cc:194] Registered new tserver with Master: 746126999fd34dafb44a65da9f79ae02 (127.12.159.194:42921)
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:36:06.470348 18534 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:46677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:36:06.498018 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45297
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:42681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:06.841518 18862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:06.841876 18862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:06.842051 18862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:06.849871 18862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:06.850016 18862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:06.850195 18862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:06.860392 18862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:42681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45297
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:06.861791 18862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:06.863229 18862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:06.877267 18870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:06.877375 18868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:06.877609 18867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:06.878525 18862 server_base.cc:1034] running on GCE node
I20260923 19:36:06.879199 18862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:06.880159 18862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:06.881368 18862 hybrid_clock.cc:648] HybridClock initialized: now 1790192166881305 us; error 63 us; skew 500 ppm
I20260923 19:36:06.881657 18862 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:06 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:06.884923 18862 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:36:06.886590 18862 webserver.cc:460] Webserver started at http://127.12.159.195:43935/ using document root <none> and password file <none>
I20260923 19:36:06.887319 18862 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:06.887475 18862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:06.887878 18862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:06.890949 18862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "d534dde0d71e4cbf8ad719bb5afb18c9"
format_stamp: "Formatted at 2026-09-23 19:36:06 on dist-test-slave-lzv7"
server_key: "90bdcccb25229edae299646d4a531f7b"
server_key_iv: "b1f1deda5429e770ecb830faef1cfcf4"
server_key_version: "encryptionkey@0"
I20260923 19:36:06.891719 18862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "d534dde0d71e4cbf8ad719bb5afb18c9"
format_stamp: "Formatted at 2026-09-23 19:36:06 on dist-test-slave-lzv7"
server_key: "90bdcccb25229edae299646d4a531f7b"
server_key_iv: "b1f1deda5429e770ecb830faef1cfcf4"
server_key_version: "encryptionkey@0"
I20260923 19:36:06.897086 18862 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:36:06.900712 18877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:06.902184 18862 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:06.902367 18862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "d534dde0d71e4cbf8ad719bb5afb18c9"
format_stamp: "Formatted at 2026-09-23 19:36:06 on dist-test-slave-lzv7"
server_key: "90bdcccb25229edae299646d4a531f7b"
server_key_iv: "b1f1deda5429e770ecb830faef1cfcf4"
server_key_version: "encryptionkey@0"
I20260923 19:36:06.902583 18862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:06.916950 18862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:06.921404 18862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:06.921710 18862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:06.922775 18862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:06.924093 18862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:06.924202 18862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:06.924357 18862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:06.924443 18862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:06.958945 18862 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:36571
I20260923 19:36:06.958993 18989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:36571 every 8 connection(s)
I20260923 19:36:06.960278 18862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:06.969607 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 18862
I20260923 19:36:06.969796 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:36:06.970260 12927 external_mini_cluster.cc:1428] Setting key ba97e6e10f08b4f0c8b34e4760793551
Sep 23 19:36:06 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:06.981752 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:06.962938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:44897 (local address 127.12.159.254:45297)
0923 19:36:06.963138 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:06.963143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:06.964311 (+ 1168us) server_negotiation.cc:407] Connection header received
0923 19:36:06.966269 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:06.966274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:06.966392 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:06.966514 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:06.968105 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.968895 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.970691 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.971243 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.971383 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:06.975710 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:06.975717 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:06.975722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:06.975764 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:06.978522 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:06.979330 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:06.979340 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:06.979342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:06.979482 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:06.979927 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:06.979937 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:06.979940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:06.980224 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:06.980387 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:06.981152 (+ 765us) server_negotiation.cc:299] Negotiation successful
0923 19:36:06.981383 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:36:06.982885 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:06.963409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45297 (local address 127.12.159.195:44897)
0923 19:36:06.964119 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:06.964157 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:06.966000 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:06.966754 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:06.966764 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:06.967282 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:06.967873 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:06.967938 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.969059 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.969065 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:06.970548 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:06.970560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:06.971486 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:06.971495 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:06.971744 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:06.972807 (+ 1063us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:06.972832 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:06.975483 (+ 2651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:06.978697 (+ 3214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:06.978708 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:06.978727 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:06.979185 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:06.979598 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:06.979602 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:06.979606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:06.979803 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:06.980363 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:06.980371 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:06.980749 (+ 378us) client_negotiation.cc:769] Sending connection context
0923 19:36:06.981044 (+ 295us) client_negotiation.cc:240] Negotiation successful
0923 19:36:06.981625 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":291,"threads_started":1}
I20260923 19:36:06.983062 18723 heartbeater.cc:503] Master 127.12.159.254:45297 was elected leader, sending a full tablet report...
I20260923 19:36:06.984967 18990 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45297
I20260923 19:36:06.985349 18990 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:06.986325 18990 heartbeater.cc:511] Master 127.12.159.254:45297 requested a full tablet report, sending...
I20260923 19:36:06.987751 18533 ts_manager.cc:194] Registered new tserver with Master: d534dde0d71e4cbf8ad719bb5afb18c9 (127.12.159.195:36571)
I20260923 19:36:06.988605 18533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:44897
I20260923 19:36:06.999478 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/test-admin.keytab.
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:07.028723 12927 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260923 19:36:07.034400 18997 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:07.031742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44696 (local address 127.12.159.193:43159)
0923 19:36:07.032454 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.032462 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.032487 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:36:07.032545 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.032552 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.032756 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.032936 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.033913 (+ 977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44696: BlockingRecv error: recv got EOF from 127.0.0.1:44696 (error 108)
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":346,"threads_started":1}
W20260923 19:36:07.034440 12927 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5cc' of type FILE
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:07.036093 12927 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:07.037487 12927 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:36:07.054257 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:07.039169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44698 (local address 127.12.159.193:43159)
0923 19:36:07.039424 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.039431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.039583 (+ 152us) server_negotiation.cc:407] Connection header received
0923 19:36:07.039766 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.039770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.039840 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.039931 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.041049 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.042206 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.043473 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.044257 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.044363 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:07.048232 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:07.048246 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:07.048263 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:07.048309 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:07.051317 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.052180 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.052187 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.052190 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.052340 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.052735 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.052738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.052740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.053122 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:07.053338 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:07.053646 (+ 308us) server_negotiation.cc:299] Negotiation successful
0923 19:36:07.053960 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
W20260923 19:36:07.060540 18997 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:07.058709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44704 (local address 127.12.159.193:43159)
0923 19:36:07.058923 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.058929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.059117 (+ 188us) server_negotiation.cc:407] Connection header received
0923 19:36:07.059319 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.059323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.059401 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.059500 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.060269 (+ 769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44704: BlockingRecv error: recv got EOF from 127.0.0.1:44704 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260923 19:36:07.060741 12927 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5cc' of type FILE
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:07.062325 12927 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:07.063580 12927 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:36:07.079134 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:07.065099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44714 (local address 127.12.159.193:43159)
0923 19:36:07.065315 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.065322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.065479 (+ 157us) server_negotiation.cc:407] Connection header received
0923 19:36:07.065618 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.065622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.065684 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.065766 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.066860 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.067554 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.068869 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.069362 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.069528 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:07.073410 (+ 3882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:07.073416 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:07.073420 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:07.073462 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:07.076653 (+ 3191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.077403 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.077408 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.077411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.077556 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.077966 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.077970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.077972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.078266 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:07.078524 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:07.078742 (+ 218us) server_negotiation.cc:299] Negotiation successful
0923 19:36:07.078912 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260923 19:36:07.083606 18997 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:07.081923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44728 (local address 127.12.159.193:43159)
0923 19:36:07.082078 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.082082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.082448 (+ 366us) server_negotiation.cc:407] Connection header received
0923 19:36:07.082569 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.082572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.082642 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.082723 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.083391 (+ 668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44728: BlockingRecv error: recv got EOF from 127.0.0.1:44728 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260923 19:36:07.083904 12927 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192117815085-12927-0/krb5kdc/krb5cc' of type FILE
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:07.085690 12927 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:07.087206 12927 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:36:07.103111 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:07.088700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44744 (local address 127.12.159.193:43159)
0923 19:36:07.088946 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.088952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.089167 (+ 215us) server_negotiation.cc:407] Connection header received
0923 19:36:07.089302 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.089306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.089373 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.089464 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.090542 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.091283 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.092627 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.093060 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.093167 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:07.097116 (+ 3949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:07.097122 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:07.097125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:07.097166 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:07.100127 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.100966 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.100970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.100973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.101118 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.101583 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.101587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.101589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.101966 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:07.102209 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:07.102533 (+ 324us) server_negotiation.cc:299] Negotiation successful
0923 19:36:07.102781 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:36:07.104693 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18595
I20260923 19:36:07.117882 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:07.105562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.12.159.193:43159)
0923 19:36:07.105831 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.105841 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.106127 (+ 286us) server_negotiation.cc:407] Connection header received
0923 19:36:07.106338 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.106344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.106412 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.106494 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.107677 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.108415 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.109747 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.110215 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.110384 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:07.112462 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:07.112466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:07.112469 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:07.112499 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:07.115190 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.115911 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.115915 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.115917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.116054 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.116442 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.116446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.116448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.116726 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:07.116942 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:07.117232 (+ 290us) server_negotiation.cc:299] Negotiation successful
0923 19:36:07.117464 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260923 19:36:07.118575 18718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:07.205022 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18595
I20260923 19:36:07.221589 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18729
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:36:07.239285 19010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:07.222699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53472 (local address 127.12.159.194:42921)
0923 19:36:07.223280 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.223287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.223312 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:36:07.223440 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.223447 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.223666 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.223801 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.224797 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.225928 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.227405 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.228011 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.228132 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:07.232526 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:07.232541 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:07.232557 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:07.232599 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:07.235932 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.236740 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.236751 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.236753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.236892 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.237363 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.237370 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.237373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.237755 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:07.238301 (+ 546us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:07.238647 (+ 346us) server_negotiation.cc:299] Negotiation successful
0923 19:36:07.238930 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":311,"threads_started":1}
I20260923 19:36:07.240669 18852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:07.324949 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18729
I20260923 19:36:07.341553 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18862
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[18489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:36:07.358707 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:07.342634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54830 (local address 127.12.159.195:36571)
0923 19:36:07.343259 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:07.343267 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:07.343296 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:36:07.343356 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:07.343362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:07.343616 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:07.343823 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:07.345055 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.346273 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.347564 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:07.348141 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:07.348285 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:07.352605 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:07.352618 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:07.352634 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:07.352673 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:07.355767 (+ 3094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.356566 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.356579 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.356582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.356708 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:07.357114 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:07.357119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:07.357122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:07.357479 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:07.357800 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:07.358128 (+ 328us) server_negotiation.cc:299] Negotiation successful
0923 19:36:07.358399 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":304,"threads_started":1}
I20260923 19:36:07.360082 18985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:07.443253 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18862
I20260923 19:36:07.459493 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 18502
I20260923 19:36:07.460671 18564 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:07.567101 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 18502
2026-09-23T19:36:07Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4010 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[19017](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[19017](info): set up 2 sockets
Sep 23 19:36:07 dist-test-slave-lzv7 krb5kdc[19017](info): commencing operation
krb5kdc: starting...
W20260923 19:36:08.718756 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:36:08 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:36:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:08Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab.
Entry for principal oryx/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab.
I20260923 19:36:08.942378 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:36803
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab
--principal=oryx/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:36803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:09.276743 19030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:09.277047 19030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:09.277226 19030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:09.284646 19030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:09.284811 19030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:09.284920 19030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:09.285012 19030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:09.285132 19030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:09.295379 19030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:36803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab
--principal=oryx/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:36803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:09.296846 19030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:09.298241 19030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:09.310940 19038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:09.310976 19036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:09.311008 19035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:09.311837 19030 server_base.cc:1034] running on GCE node
I20260923 19:36:09.312680 19030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:09.314322 19030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:09.315580 19030 hybrid_clock.cc:648] HybridClock initialized: now 1790192169315544 us; error 53 us; skew 500 ppm
I20260923 19:36:09.316047 19030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:09 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192169, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:09.319491 19030 init.cc:377] Logged in from keytab as oryx/127.12.159.254@KRBTEST.COM (short username oryx)
I20260923 19:36:09.321256 19030 webserver.cc:460] Webserver started at http://127.12.159.254:37341/ using document root <none> and password file <none>
I20260923 19:36:09.322091 19030 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:09.322247 19030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:09.322563 19030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:09.325592 19030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "9ae18a6683f4428ea5a5393ff709e6b1"
format_stamp: "Formatted at 2026-09-23 19:36:09 on dist-test-slave-lzv7"
server_key: "6dde07af43b8eadd0c0a65b335717d8a"
server_key_iv: "3b875eccf909811f5bc59a1476486ebb"
server_key_version: "encryptionkey@0"
I20260923 19:36:09.326532 19030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "9ae18a6683f4428ea5a5393ff709e6b1"
format_stamp: "Formatted at 2026-09-23 19:36:09 on dist-test-slave-lzv7"
server_key: "6dde07af43b8eadd0c0a65b335717d8a"
server_key_iv: "3b875eccf909811f5bc59a1476486ebb"
server_key_version: "encryptionkey@0"
I20260923 19:36:09.331871 19030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:36:09.335529 19045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:09.336995 19030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:36:09.337208 19030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "9ae18a6683f4428ea5a5393ff709e6b1"
format_stamp: "Formatted at 2026-09-23 19:36:09 on dist-test-slave-lzv7"
server_key: "6dde07af43b8eadd0c0a65b335717d8a"
server_key_iv: "3b875eccf909811f5bc59a1476486ebb"
server_key_version: "encryptionkey@0"
I20260923 19:36:09.337424 19030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:09.364280 19030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:09.368947 19030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:09.369270 19030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:09.388599 19030 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:36803
I20260923 19:36:09.388641 19096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:36803 every 8 connection(s)
I20260923 19:36:09.390100 19030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:09.393910 19097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:09.394548 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 19030
I20260923 19:36:09.394778 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:09.395625 12927 external_mini_cluster.cc:1428] Setting key 47f42d856992c0f726204f991f5b57a0
I20260923 19:36:09.406920 19097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: Bootstrap starting.
Sep 23 19:36:09 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:09.410365 19097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:09.411612 19097 log.cc:824] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:09.415083 19097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: No bootstrap required, opened a new log
I20260923 19:36:09.419340 19100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:09.397870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49270 (local address 127.12.159.254:36803)
0923 19:36:09.398726 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:09.398739 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:09.398783 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:36:09.400529 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:09.400552 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:09.400972 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:09.401394 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:09.402897 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:09.404211 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:09.405462 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:09.406269 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:09.406475 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:09.410953 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:09.410962 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:09.410977 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:09.411019 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:09.414675 (+ 3656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:09.415634 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:09.415641 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:09.415646 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:09.415853 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:09.416306 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:09.416310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:09.416312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:09.416878 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:09.417137 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:09.417674 (+ 537us) server_negotiation.cc:299] Negotiation successful
0923 19:36:09.418215 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":361,"threads_started":1}
I20260923 19:36:09.423691 19097 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } }
I20260923 19:36:09.424041 19097 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:09.424167 19097 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae18a6683f4428ea5a5393ff709e6b1, State: Initialized, Role: FOLLOWER
I20260923 19:36:09.424741 19097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } }
I20260923 19:36:09.424969 19097 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:09.425094 19097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:09.425267 19097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:09.427600 19097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } }
I20260923 19:36:09.428120 19097 leader_election.cc:302] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ae18a6683f4428ea5a5393ff709e6b1; no voters:
I20260923 19:36:09.428757 19097 leader_election.cc:288] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:09.428915 19102 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:09.429641 19102 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae18a6683f4428ea5a5393ff709e6b1, State: Running, Role: LEADER
I20260923 19:36:09.430431 19102 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } }
I20260923 19:36:09.430991 19097 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:09.433269 19104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ae18a6683f4428ea5a5393ff709e6b1. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } }
I20260923 19:36:09.433661 19104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:09.434284 19103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } }
I20260923 19:36:09.434649 19103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:09.434993 19111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:09.445276 19111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:09.456696 19111 catalog_manager.cc:1347] Generated new cluster ID: a8f6e8f7ceda4222bca1e99e22e5b3a4
I20260923 19:36:09.456830 19111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:09.473634 19111 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:09.475590 19111 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:09.482990 19111 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: Generated new TSK 0
I20260923 19:36:09.484115 19111 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab.
Entry for principal oryx/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab.
I20260923 19:36:09.545776 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:36803
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab
--principal=oryx/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:09.884806 19124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:09.885090 19124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:09.885186 19124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:09.892320 19124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:09.892429 19124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:09.892536 19124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:09.902114 19124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab
--principal=oryx/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:36803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:09.903815 19124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:09.905102 19124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:09.919492 19129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:09.919544 19130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:09.919597 19132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:09.920511 19124 server_base.cc:1034] running on GCE node
I20260923 19:36:09.921227 19124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:09.922353 19124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:09.923599 19124 hybrid_clock.cc:648] HybridClock initialized: now 1790192169923542 us; error 50 us; skew 500 ppm
I20260923 19:36:09.923959 19124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:09 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192169, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:09.927485 19124 init.cc:377] Logged in from keytab as oryx/127.12.159.193@KRBTEST.COM (short username oryx)
I20260923 19:36:09.929100 19124 webserver.cc:460] Webserver started at http://127.12.159.193:41625/ using document root <none> and password file <none>
I20260923 19:36:09.929972 19124 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:09.930140 19124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:09.930480 19124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:09.934007 19124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "6ec1339286574c59a237f1790aae02e3"
format_stamp: "Formatted at 2026-09-23 19:36:09 on dist-test-slave-lzv7"
server_key: "553ba6b6ae135e9ce2aa9c3efb533dd0"
server_key_iv: "0799e9d05f36ed0acc247626fa11e24c"
server_key_version: "encryptionkey@0"
I20260923 19:36:09.934998 19124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "6ec1339286574c59a237f1790aae02e3"
format_stamp: "Formatted at 2026-09-23 19:36:09 on dist-test-slave-lzv7"
server_key: "553ba6b6ae135e9ce2aa9c3efb533dd0"
server_key_iv: "0799e9d05f36ed0acc247626fa11e24c"
server_key_version: "encryptionkey@0"
I20260923 19:36:09.940876 19124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:36:09.944833 19139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:09.946431 19124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:36:09.946615 19124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "6ec1339286574c59a237f1790aae02e3"
format_stamp: "Formatted at 2026-09-23 19:36:09 on dist-test-slave-lzv7"
server_key: "553ba6b6ae135e9ce2aa9c3efb533dd0"
server_key_iv: "0799e9d05f36ed0acc247626fa11e24c"
server_key_version: "encryptionkey@0"
I20260923 19:36:09.946830 19124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:09.959865 19124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:09.964371 19124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:09.964685 19124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:09.965667 19124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:09.967089 19124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:09.967195 19124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:09.967344 19124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:09.967417 19124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:10.001763 19124 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:43583
I20260923 19:36:10.001864 19251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:43583 every 8 connection(s)
I20260923 19:36:10.003118 19124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:10.007539 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 19124
I20260923 19:36:10.007759 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:36:10.008615 12927 external_mini_cluster.cc:1428] Setting key 7f118c9c843974b6c880b614d17917fa
Sep 23 19:36:10 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192169, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:10.024710 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:10.006102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:51031 (local address 127.12.159.254:36803)
0923 19:36:10.006533 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:10.006538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:10.007682 (+ 1144us) server_negotiation.cc:407] Connection header received
0923 19:36:10.010537 (+ 2855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:10.010541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:10.010607 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:10.010733 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:10.012284 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.013000 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.014659 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.015063 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.015206 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:10.018970 (+ 3764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:10.018975 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:10.018979 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:10.019012 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:10.021583 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:10.022386 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:10.022392 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:10.022400 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:10.022520 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:10.022955 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:10.022960 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:10.022964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:10.023228 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:10.023389 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:10.024099 (+ 710us) server_negotiation.cc:299] Negotiation successful
0923 19:36:10.024333 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":217,"threads_started":1}
I20260923 19:36:10.025713 19255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:10.006635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:51031)
0923 19:36:10.007490 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:10.007555 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:10.010234 (+ 2679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:10.010981 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:10.010990 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:10.011503 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:10.012105 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:10.012122 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.013160 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.013165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:10.014499 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:10.014511 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.015294 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.015302 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:10.015561 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:10.016281 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:10.016303 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:10.018710 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:10.021731 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:10.021740 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:10.021758 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:10.022247 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:10.022635 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:10.022642 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:10.022645 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:10.022835 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:10.023365 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:10.023374 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:10.023720 (+ 346us) client_negotiation.cc:769] Sending connection context
0923 19:36:10.023999 (+ 279us) client_negotiation.cc:240] Negotiation successful
0923 19:36:10.024570 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":314,"threads_started":1}
I20260923 19:36:10.027446 19252 heartbeater.cc:347] Connected to a master server at 127.12.159.254:36803
WARNING: no policy specified for oryx/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:36:10.027812 19252 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:10.028638 19252 heartbeater.cc:511] Master 127.12.159.254:36803 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.194@KRBTEST.COM" created.
I20260923 19:36:10.031075 19062 ts_manager.cc:194] Registered new tserver with Master: 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583)
I20260923 19:36:10.032769 19062 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:51031
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab.
Entry for principal oryx/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab.
I20260923 19:36:10.057930 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:36803
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab
--principal=oryx/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:10.385277 19258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:10.385628 19258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:10.385797 19258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:10.393301 19258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:10.393462 19258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:10.393644 19258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:10.403594 19258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab
--principal=oryx/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:36803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:10.404886 19258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:10.406337 19258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:10.420233 19263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:10.420285 19264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:10.420702 19266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:10.421535 19258 server_base.cc:1034] running on GCE node
I20260923 19:36:10.422240 19258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:10.423207 19258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:10.424423 19258 hybrid_clock.cc:648] HybridClock initialized: now 1790192170424382 us; error 30 us; skew 500 ppm
I20260923 19:36:10.424722 19258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:10 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192170, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:10.428054 19258 init.cc:377] Logged in from keytab as oryx/127.12.159.194@KRBTEST.COM (short username oryx)
I20260923 19:36:10.429535 19258 webserver.cc:460] Webserver started at http://127.12.159.194:41037/ using document root <none> and password file <none>
I20260923 19:36:10.430332 19258 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:10.430495 19258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:10.430837 19258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:10.434240 19258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "1bd59290fd3b46e2bcd3bbb61c123a58"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "a64ad3aab92786b82c7d12e89013c0fd"
server_key_iv: "e25789a4ec3cc53d3a9f0fb1b29d14ac"
server_key_version: "encryptionkey@0"
I20260923 19:36:10.435122 19258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "1bd59290fd3b46e2bcd3bbb61c123a58"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "a64ad3aab92786b82c7d12e89013c0fd"
server_key_iv: "e25789a4ec3cc53d3a9f0fb1b29d14ac"
server_key_version: "encryptionkey@0"
I20260923 19:36:10.440716 19258 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:36:10.444377 19273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:10.445928 19258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:36:10.446113 19258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "1bd59290fd3b46e2bcd3bbb61c123a58"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "a64ad3aab92786b82c7d12e89013c0fd"
server_key_iv: "e25789a4ec3cc53d3a9f0fb1b29d14ac"
server_key_version: "encryptionkey@0"
I20260923 19:36:10.446374 19258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:10.461263 19258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:10.465662 19258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:10.465993 19258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:10.466918 19258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:10.468393 19258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:10.468467 19258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:10.468549 19258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:10.468595 19258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:10.502177 19258 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:34749
I20260923 19:36:10.502223 19385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:34749 every 8 connection(s)
I20260923 19:36:10.503543 19258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:10.508762 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 19258
I20260923 19:36:10.508945 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:36:10.509516 12927 external_mini_cluster.cc:1428] Setting key 8c60f980930dac92065738c2ba39ead7
Sep 23 19:36:10 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192170, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:10.531327 19388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:10.506694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:51611)
0923 19:36:10.507484 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:10.507532 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:10.509775 (+ 2243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:10.510688 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:10.510709 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:10.511391 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:10.512254 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:10.512282 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.513328 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.513337 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:10.515561 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:10.515579 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.516425 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.516434 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:10.516800 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:10.517601 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:10.517635 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:10.520454 (+ 2819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:10.524944 (+ 4490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:10.524955 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:10.525012 (+ 57us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:10.526380 (+ 1368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:10.527128 (+ 748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:10.527134 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:10.527138 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:10.527554 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:10.528438 (+ 884us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:10.528450 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:10.528924 (+ 474us) client_negotiation.cc:769] Sending connection context
0923 19:36:10.529280 (+ 356us) client_negotiation.cc:240] Negotiation successful
0923 19:36:10.529882 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":315,"threads_started":1}
I20260923 19:36:10.532310 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:10.506310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:51611 (local address 127.12.159.254:36803)
0923 19:36:10.506487 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:10.506492 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:10.507659 (+ 1167us) server_negotiation.cc:407] Connection header received
0923 19:36:10.510190 (+ 2531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:10.510196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:10.510292 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:10.510401 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:10.512444 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.513161 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.515727 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:10.516167 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:10.516283 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:10.520741 (+ 4458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:10.520750 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:10.520758 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:10.520807 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:10.524752 (+ 3945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:10.526580 (+ 1828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:10.526614 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:10.526620 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:10.526974 (+ 354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:10.527742 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:10.527753 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:10.527756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:10.528202 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:10.528359 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:10.531885 (+ 3526us) server_negotiation.cc:299] Negotiation successful
0923 19:36:10.532084 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:36:10.533751 19386 heartbeater.cc:347] Connected to a master server at 127.12.159.254:36803
WARNING: no policy specified for oryx/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:36:10.534242 19386 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:10.535107 19386 heartbeater.cc:511] Master 127.12.159.254:36803 requested a full tablet report, sending...
I20260923 19:36:10.536862 19062 ts_manager.cc:194] Registered new tserver with Master: 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.195@KRBTEST.COM" created.
I20260923 19:36:10.537891 19062 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:51611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab.
Entry for principal oryx/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab.
I20260923 19:36:10.566233 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:36803
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab
--principal=oryx/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:10.902472 19391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:10.902752 19391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:10.902853 19391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:10.910760 19391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:10.910889 19391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:10.911006 19391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:10.921345 19391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab
--principal=oryx/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:36803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:10.922663 19391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:10.923930 19391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:10.938038 19396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:10.937951 19397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:10.937984 19399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:10.938647 19391 server_base.cc:1034] running on GCE node
I20260923 19:36:10.939410 19391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:10.940320 19391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:10.941524 19391 hybrid_clock.cc:648] HybridClock initialized: now 1790192170941451 us; error 74 us; skew 500 ppm
I20260923 19:36:10.941893 19391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:10 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192170, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:10.945537 19391 init.cc:377] Logged in from keytab as oryx/127.12.159.195@KRBTEST.COM (short username oryx)
I20260923 19:36:10.947147 19391 webserver.cc:460] Webserver started at http://127.12.159.195:37805/ using document root <none> and password file <none>
I20260923 19:36:10.947860 19391 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:10.948016 19391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:10.948342 19391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:10.951666 19391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "dbb307c3048e491abf2eaf969fbdc021"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "0ef9ef23422b700997e23a7c5c7a8d2a"
server_key_iv: "f99c708b409cde2c4a8a36c69d4f6679"
server_key_version: "encryptionkey@0"
I20260923 19:36:10.952564 19391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "dbb307c3048e491abf2eaf969fbdc021"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "0ef9ef23422b700997e23a7c5c7a8d2a"
server_key_iv: "f99c708b409cde2c4a8a36c69d4f6679"
server_key_version: "encryptionkey@0"
I20260923 19:36:10.958310 19391 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260923 19:36:10.962138 19406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:10.963667 19391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:36:10.963876 19391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "dbb307c3048e491abf2eaf969fbdc021"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "0ef9ef23422b700997e23a7c5c7a8d2a"
server_key_iv: "f99c708b409cde2c4a8a36c69d4f6679"
server_key_version: "encryptionkey@0"
I20260923 19:36:10.964100 19391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:10.999025 19391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:11.003700 19391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:11.004005 19391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:11.004980 19391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:11.006433 19391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:11.006538 19391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:11.006685 19391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:11.006757 19391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:11.036160 19252 heartbeater.cc:503] Master 127.12.159.254:36803 was elected leader, sending a full tablet report...
I20260923 19:36:11.042296 19391 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:33811
I20260923 19:36:11.042317 19518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:33811 every 8 connection(s)
I20260923 19:36:11.043596 19391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:11.048399 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 19391
I20260923 19:36:11.048601 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:36:11.049281 12927 external_mini_cluster.cc:1428] Setting key 24d3c50968015a23bdc810567650a700
Sep 23 19:36:11 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192170, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:11.066148 19521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.046219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:32907 (local address 127.12.159.254:36803)
0923 19:36:11.046671 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.046675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.047684 (+ 1009us) server_negotiation.cc:407] Connection header received
0923 19:36:11.049673 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.049680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.049770 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.049943 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.051936 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.053104 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.054967 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.055367 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.055465 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.059154 (+ 3689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.059160 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.059163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.059197 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.062125 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.062978 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.062985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.062989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.063209 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.063843 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.063848 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.063850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.064211 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.064384 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.065374 (+ 990us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.065761 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":258,"threads_started":1}
I20260923 19:36:11.067132 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.046871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:32907)
0923 19:36:11.047527 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:11.047563 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:11.049333 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:11.050294 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:11.050307 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:11.051018 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:11.051765 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.051786 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.053278 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.053282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.054808 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.054820 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.055619 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.055625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.055852 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.056555 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:11.056582 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:11.058949 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:11.062316 (+ 3367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.062323 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.062338 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.062805 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.063357 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.063361 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.063363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.063679 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.064375 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:11.064383 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:11.064838 (+ 455us) client_negotiation.cc:769] Sending connection context
0923 19:36:11.065202 (+ 364us) client_negotiation.cc:240] Negotiation successful
0923 19:36:11.065904 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":254,"threads_started":1}
I20260923 19:36:11.068682 19519 heartbeater.cc:347] Connected to a master server at 127.12.159.254:36803
I20260923 19:36:11.069008 19519 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:11.069871 19519 heartbeater.cc:511] Master 127.12.159.254:36803 requested a full tablet report, sending...
I20260923 19:36:11.071332 19062 ts_manager.cc:194] Registered new tserver with Master: dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811)
I20260923 19:36:11.072139 19062 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:32907
I20260923 19:36:11.078799 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.159.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.253.keytab.
Entry for principal oryx/127.12.159.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.253.keytab.
I20260923 19:36:11.130959 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:33685
--webserver_interface=127.12.159.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.253.keytab
--principal=oryx/127.12.159.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:36803,127.12.159.253:33685
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:11.462302 19525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:11.462637 19525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:11.462782 19525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:11.470376 19525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:11.470526 19525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:11.470633 19525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:11.470733 19525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:11.470811 19525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:11.480903 19525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:36803,127.12.159.253:33685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.253.keytab
--principal=oryx/127.12.159.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:33685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.159.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
W20260923 19:36:11.481345 19525 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.159.254:36803,127.12.159.253:33685'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260923 19:36:11.482517 19525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:11.483748 19525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:11.495607 19530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:11.495640 19533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:11.495570 19531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:11.496572 19525 server_base.cc:1034] running on GCE node
I20260923 19:36:11.497292 19525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:11.498739 19525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:11.499984 19525 hybrid_clock.cc:648] HybridClock initialized: now 1790192171499900 us; error 55 us; skew 500 ppm
I20260923 19:36:11.500365 19525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:11 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192171, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:11.503996 19525 init.cc:377] Logged in from keytab as oryx/127.12.159.253@KRBTEST.COM (short username oryx)
I20260923 19:36:11.505846 19525 webserver.cc:460] Webserver started at http://127.12.159.253:33701/ using document root <none> and password file <none>
I20260923 19:36:11.506597 19525 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:11.506733 19525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:11.507071 19525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:11.510401 19525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/instance:
uuid: "5f284bb429c04c698b34668f80de70c7"
format_stamp: "Formatted at 2026-09-23 19:36:11 on dist-test-slave-lzv7"
server_key: "cded9ca57f27be12f8610bc24be6a0ee"
server_key_iv: "b4e6f2aae4156873d5cb645e7e60a8a2"
server_key_version: "encryptionkey@0"
I20260923 19:36:11.511219 19525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal/instance:
uuid: "5f284bb429c04c698b34668f80de70c7"
format_stamp: "Formatted at 2026-09-23 19:36:11 on dist-test-slave-lzv7"
server_key: "cded9ca57f27be12f8610bc24be6a0ee"
server_key_iv: "b4e6f2aae4156873d5cb645e7e60a8a2"
server_key_version: "encryptionkey@0"
I20260923 19:36:11.516654 19525 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:36:11.520359 19540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:11.521929 19525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:36:11.522111 19525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
uuid: "5f284bb429c04c698b34668f80de70c7"
format_stamp: "Formatted at 2026-09-23 19:36:11 on dist-test-slave-lzv7"
server_key: "cded9ca57f27be12f8610bc24be6a0ee"
server_key_iv: "b4e6f2aae4156873d5cb645e7e60a8a2"
server_key_version: "encryptionkey@0"
I20260923 19:36:11.522356 19525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:11.537461 19525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:11.541503 19386 heartbeater.cc:503] Master 127.12.159.254:36803 was elected leader, sending a full tablet report...
I20260923 19:36:11.542091 19525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:11.542428 19525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:11.561952 19525 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.253:33685
I20260923 19:36:11.561935 19591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.253:33685 every 8 connection(s)
I20260923 19:36:11.563400 19525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
I20260923 19:36:11.567364 19592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:11.573408 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 19525
I20260923 19:36:11.574312 19592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:36:11 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192171, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.253@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
Sep 23 19:36:11 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.253@KRBTEST.COM
I20260923 19:36:11.595029 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.577457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49278 (local address 127.12.159.254:36803)
0923 19:36:11.578931 (+ 1474us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.578938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.578964 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:36:11.579326 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.579330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.579395 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.579488 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.580890 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.581724 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.583480 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.583965 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.584058 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.588008 (+ 3950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.588017 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.588021 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.588078 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.591144 (+ 3066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.592191 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.592199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.592203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.592346 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.592858 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.592863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.592866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.593323 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.593477 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.594461 (+ 984us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.594658 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1354,"thread_start_us":1210,"threads_started":1}
I20260923 19:36:11.596282 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.577378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49278)
0923 19:36:11.578153 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:11.578204 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:11.579051 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:11.579588 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:11.579595 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:11.580335 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:11.580696 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.580713 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.581922 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.581927 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.583329 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.583340 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.584180 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.584187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.584573 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.585380 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:11.585403 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:11.587795 (+ 2392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:11.591276 (+ 3481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.591288 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.591306 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.591945 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.592464 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.592470 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.592473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.592715 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.593460 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:11.593468 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:11.593972 (+ 504us) client_negotiation.cc:769] Sending connection context
0923 19:36:11.594351 (+ 379us) client_negotiation.cc:240] Negotiation successful
0923 19:36:11.594891 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":62,"thread_start_us":296,"threads_started":1}
I20260923 19:36:11.596298 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.575778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44468 (local address 127.12.159.253:33685)
0923 19:36:11.576576 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.576588 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.576629 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:36:11.579029 (+ 2400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.579067 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.579388 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.579591 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.581000 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.582430 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.583698 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.584511 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.584627 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.589258 (+ 4631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.589266 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.589279 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.589308 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.592491 (+ 3183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.593458 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.593468 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.593471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.593661 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.594190 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.594194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.594197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.594603 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.594893 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.595825 (+ 932us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.595997 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":580,"thread_start_us":353,"threads_started":1}
I20260923 19:36:11.598424 19592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:36:11 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192171, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.253@KRBTEST.COM for oryx/127.12.159.253@KRBTEST.COM
I20260923 19:36:11.610895 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.599395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.0.0.1:44480)
0923 19:36:11.599682 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:11.599700 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:11.599823 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:11.600104 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:11.600108 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:11.600458 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:11.600582 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.600590 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.601559 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.601567 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.602486 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.602496 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.603171 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.603176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.603395 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.603928 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:11.603944 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:11.606060 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:11.608712 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.608716 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.608719 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.609095 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.609420 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.609423 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.609425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.609585 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.610114 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:11.610118 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:11.610257 (+ 139us) client_negotiation.cc:769] Sending connection context
0923 19:36:11.610379 (+ 122us) client_negotiation.cc:240] Negotiation successful
0923 19:36:11.610625 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":4}
I20260923 19:36:11.611020 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.599466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44480 (local address 127.12.159.253:33685)
0923 19:36:11.599667 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.599673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.599767 (+ 94us) server_negotiation.cc:407] Connection header received
0923 19:36:11.599935 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.599939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.599997 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.600092 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.600707 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.601423 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.602623 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.603028 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.603164 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.606229 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.606233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.606237 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.606265 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.608585 (+ 2320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.609203 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.609206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.609209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.609322 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.609658 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.609661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.609663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.609993 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.610115 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.610465 (+ 350us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.610737 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":137,"server-negotiator.queue_time_us":71}
I20260923 19:36:11.615856 19592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Bootstrap starting.
I20260923 19:36:11.619076 19592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:11.620106 19592 log.cc:824] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:11.622936 19592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: No bootstrap required, opened a new log
I20260923 19:36:11.630206 19592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } }
I20260923 19:36:11.630586 19592 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:11.630682 19592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f284bb429c04c698b34668f80de70c7, State: Initialized, Role: FOLLOWER
I20260923 19:36:11.631368 19592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } }
I20260923 19:36:11.632339 19599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } } }
I20260923 19:36:11.632696 19599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:11.633333 19592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:36:11.642242 19610 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:36:11.642514 19610 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:36:11.644755 19525 master_runner.cc:428] Detected that this master 5f284bb429c04c698b34668f80de70c7 is joining an existing cluster
I20260923 19:36:11.644845 19525 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.159.253:33685
I20260923 19:36:11.666738 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.648672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49290 (local address 127.12.159.254:36803)
0923 19:36:11.649203 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.649208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.649960 (+ 752us) server_negotiation.cc:407] Connection header received
0923 19:36:11.650129 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.650134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.650239 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.650337 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.651905 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.653037 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.655480 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.656421 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.656551 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.659676 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.659687 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.659693 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.659745 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.663239 (+ 3494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.664101 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.664108 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.664112 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.664271 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.664755 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.664761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.664766 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.665133 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.665269 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.666014 (+ 745us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.666304 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403}
I20260923 19:36:11.666759 19616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.648729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49290)
0923 19:36:11.649788 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:11.649827 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:11.649984 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:11.650509 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:11.650513 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:11.651246 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:11.651698 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.651715 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.653246 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.653255 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.655301 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.655320 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.656927 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.656937 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.657267 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.658061 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:11.658086 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:11.659418 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:11.663404 (+ 3986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.663409 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.663413 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.663946 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.664416 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.664421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.664424 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.664621 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.665356 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:11.665361 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:11.665657 (+ 296us) client_negotiation.cc:769] Sending connection context
0923 19:36:11.665872 (+ 215us) client_negotiation.cc:240] Negotiation successful
0923 19:36:11.666214 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":923,"mutex_wait_us":33,"thread_start_us":730,"threads_started":1}
I20260923 19:36:11.677597 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.649097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44482 (local address 127.12.159.253:33685)
0923 19:36:11.649410 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.649420 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.657312 (+ 7892us) server_negotiation.cc:407] Connection header received
0923 19:36:11.657792 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.657799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.657919 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.658026 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.659625 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.660806 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.663862 (+ 3056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.664709 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.664816 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.669248 (+ 4432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.669257 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.669264 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.669303 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.673863 (+ 4560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.674818 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.674826 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.674831 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.674991 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.675430 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.675437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.675443 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.675960 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.676139 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.676728 (+ 589us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.677053 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:36:11.679541 19617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.648906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.0.0.1:44482)
0923 19:36:11.657212 (+ 8306us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:11.657235 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:11.657640 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:11.658209 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:11.658220 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:11.659090 (+ 870us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:11.659469 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.659484 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.661864 (+ 2380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.661872 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.663716 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.663732 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.665119 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.665127 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.665342 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.667708 (+ 2366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:11.667736 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:11.669041 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:11.674044 (+ 5003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.674049 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.674054 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.674676 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.675141 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.675149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.675155 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.675316 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.676217 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:11.676224 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:11.676417 (+ 193us) client_negotiation.cc:769] Sending connection context
0923 19:36:11.678418 (+ 2001us) client_negotiation.cc:240] Negotiation successful
0923 19:36:11.678837 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8144,"mutex_wait_us":33,"thread_start_us":8413,"threads_started":1}
WARNING: no policy specified for oryx/127.12.159.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.252@KRBTEST.COM" created.
Sep 23 19:36:11 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192169, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.254@KRBTEST.COM for oryx/127.12.159.253@KRBTEST.COM
I20260923 19:36:11.707242 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.675295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44496 (local address 127.12.159.253:33685)
0923 19:36:11.678371 (+ 3076us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.678379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.687880 (+ 9501us) server_negotiation.cc:407] Connection header received
0923 19:36:11.688331 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.688338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.688465 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.688648 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.690502 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.691616 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.693801 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.694598 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.694737 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.699556 (+ 4819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.699564 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.699578 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.699636 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.703512 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.704656 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.704663 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.704667 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.704852 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.705340 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.705345 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.705348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.705741 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.705930 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.706552 (+ 622us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.706807 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2932,"thread_start_us":11107,"threads_started":1}
I20260923 19:36:11.707293 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.674953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.0.0.1:44496)
0923 19:36:11.687711 (+ 12758us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:11.687775 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:11.688058 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:11.688703 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:11.688719 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:11.689906 (+ 1187us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:11.690306 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.690322 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.691785 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.691794 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.693627 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.693646 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.694807 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.694815 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.695066 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.695929 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:11.695958 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:11.699304 (+ 3346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:11.703731 (+ 4427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.703755 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.703764 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.704485 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.704989 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.704998 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.705004 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.705195 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.705933 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:11.705942 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:11.706179 (+ 237us) client_negotiation.cc:769] Sending connection context
0923 19:36:11.706405 (+ 226us) client_negotiation.cc:240] Negotiation successful
0923 19:36:11.706808 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12425,"thread_start_us":12272,"threads_started":1}
I20260923 19:36:11.710136 19062 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.159.253:33685: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5f284bb429c04c698b34668f80de70c7"
member_type: NON_VOTER
last_known_addr {
host: "127.12.159.253"
port: 33685
}
attrs {
promote: true
}
}
dest_uuid: "9ae18a6683f4428ea5a5393ff709e6b1"
cas_config_opid_index: -1
I20260923 19:36:11.711305 19062 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } }
I20260923 19:36:11.715029 19624 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5f284bb429c04c698b34668f80de70c7 (127.12.159.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:11.715929 19567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.252.keytab.
Entry for principal oryx/127.12.159.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.252.keytab.
I20260923 19:36:11.718601 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:41375
--webserver_interface=127.12.159.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.252.keytab
--principal=oryx/127.12.159.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:36:11.719961 19567 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Refusing update from remote peer 9ae18a6683f4428ea5a5393ff709e6b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260923 19:36:11.721114 19623 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:11.725955 19624 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.159.253:33685
I20260923 19:36:11.726711 19525 master.cc:537] Master@127.12.159.253:33685 shutting down...
I20260923 19:36:11.726573 19624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:11.726814 19624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:11.754900 19567 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5f284bb429c04c698b34668f80de70c7 (127.12.159.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:11.770517 19633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:11.771044 19599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ae18a6683f4428ea5a5393ff709e6b1. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:11.771325 19599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:36:11.771039 19633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:36:11.771381 19629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:11.771816 19629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:36:11.774513 19525 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 LEARNER]: Raft consensus shutting down.
I20260923 19:36:11.775018 19525 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 LEARNER]: Raft consensus is shut down!
I20260923 19:36:11.775198 19525 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: stopping tablet replica
I20260923 19:36:11.783347 19525 master.cc:552] Master@127.12.159.253:33685 shutdown complete.
I20260923 19:36:11.783453 19525 master_runner.cc:305] Clearing existing system tablet
I20260923 19:36:11.783826 19525 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:11.783939 19525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:11.786242 19525 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260923 19:36:11.787850 19635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:11.788151 19525 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:11.788457 19525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 19:36:11.788540 19525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
uuid: "5f284bb429c04c698b34668f80de70c7"
format_stamp: "Formatted at 2026-09-23 19:36:11 on dist-test-slave-lzv7"
server_key: "cded9ca57f27be12f8610bc24be6a0ee"
server_key_iv: "b4e6f2aae4156873d5cb645e7e60a8a2"
server_key_version: "encryptionkey@0"
I20260923 19:36:11.791641 19525 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:11.796376 19525 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 19:36:11.796572 19525 log.cc:1196] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260923 19:36:11.796998 19525 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Deleting consensus metadata
I20260923 19:36:11.797260 19525 master_runner.cc:315] Copying system tablet from 127.12.159.254:36803
I20260923 19:36:11.805763 19525 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: tablet copy: Beginning tablet copy session from remote peer at address 127.12.159.254:36803
I20260923 19:36:11.818676 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.806622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49296 (local address 127.12.159.254:36803)
0923 19:36:11.806830 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:11.806837 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:11.807302 (+ 465us) server_negotiation.cc:407] Connection header received
0923 19:36:11.807530 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:11.807536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:11.807630 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:11.807744 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:11.808542 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.809464 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.810859 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.811285 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.811424 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.813240 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:11.813246 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:11.813250 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:11.813290 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:11.815907 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.816587 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.816593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.816595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.816751 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:11.817148 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:11.817155 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:11.817158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:11.817416 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:11.817571 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:11.818057 (+ 486us) server_negotiation.cc:299] Negotiation successful
0923 19:36:11.818273 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 19:36:11.818696 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:11.806622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49296)
0923 19:36:11.807191 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:11.807211 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:11.807378 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:11.807768 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:11.807773 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:11.808184 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:11.808389 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.808398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.809596 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.809603 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.810710 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:11.810726 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:11.811438 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:11.811447 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:11.811643 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:11.812265 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:11.812282 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:11.813039 (+ 757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:11.816046 (+ 3007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.816052 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.816056 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.816414 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.816897 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:11.816902 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:11.816905 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:11.817028 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:11.817535 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:11.817540 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:11.817706 (+ 166us) client_negotiation.cc:769] Sending connection context
0923 19:36:11.817953 (+ 247us) client_negotiation.cc:240] Negotiation successful
0923 19:36:11.818273 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":270,"threads_started":1}
I20260923 19:36:11.819808 19082 tablet_copy_service.cc:140] P 9ae18a6683f4428ea5a5393ff709e6b1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5f284bb429c04c698b34668f80de70c7 ({username='oryx', principal='oryx/127.12.159.253@KRBTEST.COM'} at 127.0.0.1:49296)
I20260923 19:36:11.820379 19082 tablet_copy_service.cc:161] P 9ae18a6683f4428ea5a5393ff709e6b1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5f284bb429c04c698b34668f80de70c7 at {username='oryx', principal='oryx/127.12.159.253@KRBTEST.COM'} at 127.0.0.1:49296: session id = 5f284bb429c04c698b34668f80de70c7-00000000000000000000000000000000
I20260923 19:36:11.823467 19082 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 19:36:11.825276 19525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 19:36:11.829989 19525 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: tablet copy: Starting download of 0 data blocks...
I20260923 19:36:11.830293 19525 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: tablet copy: Starting download of 1 WAL segments...
I20260923 19:36:11.832883 19525 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 19:36:11.836910 19082 tablet_copy_service.cc:342] P 9ae18a6683f4428ea5a5393ff709e6b1: Request end of tablet copy session 5f284bb429c04c698b34668f80de70c7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.159.253@KRBTEST.COM'} at 127.0.0.1:49296
I20260923 19:36:11.837127 19082 tablet_copy_service.cc:433] P 9ae18a6683f4428ea5a5393ff709e6b1: ending tablet copy session 5f284bb429c04c698b34668f80de70c7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5f284bb429c04c698b34668f80de70c7
I20260923 19:36:11.848457 19525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:11.851257 19642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:11.855412 19643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:11.862565 19645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:11.863924 19525 server_base.cc:1034] running on GCE node
I20260923 19:36:11.864281 19525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:11.864961 19525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:11.866266 19525 hybrid_clock.cc:648] HybridClock initialized: now 1790192171866164 us; error 54 us; skew 500 ppm
I20260923 19:36:11.866519 19525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:11 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192171, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:11.868521 19525 init.cc:377] Logged in from keytab as oryx/127.12.159.253@KRBTEST.COM (short username oryx)
I20260923 19:36:11.874814 19525 webserver.cc:460] Webserver started at http://127.12.159.253:39613/ using document root <none> and password file <none>
I20260923 19:36:11.875191 19525 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:11.875286 19525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:11.877874 19525 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260923 19:36:11.879482 19652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:11.879878 19525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260923 19:36:11.880052 19525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
uuid: "5f284bb429c04c698b34668f80de70c7"
format_stamp: "Formatted at 2026-09-23 19:36:11 on dist-test-slave-lzv7"
server_key: "cded9ca57f27be12f8610bc24be6a0ee"
server_key_iv: "b4e6f2aae4156873d5cb645e7e60a8a2"
server_key_version: "encryptionkey@0"
I20260923 19:36:11.880244 19525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:11.903275 19525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:11.906765 19525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:11.938978 19525 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.253:33685
I20260923 19:36:11.938978 19703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.253:33685 every 8 connection(s)
I20260923 19:36:11.939976 19525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
I20260923 19:36:11.947376 19704 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:36:11.950070 19704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Bootstrap starting.
I20260923 19:36:11.960472 19704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:36:11.960935 19704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Bootstrap complete.
I20260923 19:36:11.961870 19704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } }
I20260923 19:36:11.962098 19704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5f284bb429c04c698b34668f80de70c7, State: Initialized, Role: LEARNER
I20260923 19:36:11.962354 19704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } }
I20260923 19:36:11.963152 19707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:11.963529 19704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:11.963593 19707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:36:11.973073 19718 catalog_manager.cc:1259] Loaded cluster ID: a8f6e8f7ceda4222bca1e99e22e5b3a4
I20260923 19:36:11.973197 19718 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: loading cluster ID for follower catalog manager: success
I20260923 19:36:11.975876 19718 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: acquiring CA information for follower catalog manager: success
I20260923 19:36:11.977723 19718 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:36:12.074921 19519 heartbeater.cc:503] Master 127.12.159.254:36803 was elected leader, sending a full tablet report...
W20260923 19:36:12.124431 19625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:12.124801 19625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:12.124969 19625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:12.132656 19625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:12.132807 19625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:12.132913 19625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:12.133016 19625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:12.133096 19625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:12.143601 19625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.252.keytab
--principal=oryx/127.12.159.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:41375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.159.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:12.145004 19625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:12.146378 19625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:12.159035 19726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:12.158836 19724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:12.159375 19723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:12.160440 19625 server_base.cc:1034] running on GCE node
I20260923 19:36:12.161247 19625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:12.162796 19625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:12.164043 19625 hybrid_clock.cc:648] HybridClock initialized: now 1790192172163975 us; error 63 us; skew 500 ppm
I20260923 19:36:12.164461 19625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192172, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:12.168040 19625 init.cc:377] Logged in from keytab as oryx/127.12.159.252@KRBTEST.COM (short username oryx)
I20260923 19:36:12.169732 19625 webserver.cc:460] Webserver started at http://127.12.159.252:42189/ using document root <none> and password file <none>
I20260923 19:36:12.170488 19625 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:12.170646 19625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:12.170955 19625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:12.174113 19625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/instance:
uuid: "8854a52e27364d7094151c6aec4ce0eb"
format_stamp: "Formatted at 2026-09-23 19:36:12 on dist-test-slave-lzv7"
server_key: "2280d5c978117b42c07a09ac248b3dba"
server_key_iv: "101033cc99f67531d79e1fe9b4c1f57e"
server_key_version: "encryptionkey@0"
I20260923 19:36:12.174904 19625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal/instance:
uuid: "8854a52e27364d7094151c6aec4ce0eb"
format_stamp: "Formatted at 2026-09-23 19:36:12 on dist-test-slave-lzv7"
server_key: "2280d5c978117b42c07a09ac248b3dba"
server_key_iv: "101033cc99f67531d79e1fe9b4c1f57e"
server_key_version: "encryptionkey@0"
I20260923 19:36:12.180339 19625 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:36:12.183877 19733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:12.185273 19625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:36:12.185470 19625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
uuid: "8854a52e27364d7094151c6aec4ce0eb"
format_stamp: "Formatted at 2026-09-23 19:36:12 on dist-test-slave-lzv7"
server_key: "2280d5c978117b42c07a09ac248b3dba"
server_key_iv: "101033cc99f67531d79e1fe9b4c1f57e"
server_key_version: "encryptionkey@0"
I20260923 19:36:12.185684 19625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:12.200078 19625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:12.204216 19625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:12.204516 19625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:12.223739 19625 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.252:41375
I20260923 19:36:12.223762 19784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.252:41375 every 8 connection(s)
I20260923 19:36:12.225180 19625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
I20260923 19:36:12.227200 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 19625
I20260923 19:36:12.229945 19785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:12.239291 19785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.252@KRBTEST.COM
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192172, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.252@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:12.252578 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.229616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55254 (local address 127.12.159.252:41375)
0923 19:36:12.230558 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.230585 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.230885 (+ 300us) server_negotiation.cc:407] Connection header received
0923 19:36:12.232712 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.232734 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.233147 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.233544 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.235428 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.236843 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.238730 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.239461 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.239606 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.244737 (+ 5131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.244751 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.244767 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.244812 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.248126 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.248818 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.248829 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.248837 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.249051 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.249536 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.249540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.249542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.250207 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.250676 (+ 469us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.250996 (+ 320us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.251401 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"spinlock_wait_cycles":17664,"thread_start_us":396,"threads_started":1}
I20260923 19:36:12.258694 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.242582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49298 (local address 127.12.159.254:36803)
0923 19:36:12.242792 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.242798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.243664 (+ 866us) server_negotiation.cc:407] Connection header received
0923 19:36:12.243935 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.243943 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.244036 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.244155 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.245594 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.246756 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.248330 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.248720 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.248863 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.252443 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.252450 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.252455 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.252497 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.256031 (+ 3534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.256786 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.256790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.256793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.256925 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.257306 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.257310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.257312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.257621 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.257756 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.258273 (+ 517us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.258463 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:36:12.258723 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.242731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49298)
0923 19:36:12.243530 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.243580 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.243784 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.244210 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.244215 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.245004 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.245384 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.245401 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.246926 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.246930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.248149 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.248161 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.248912 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.248918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.249038 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.249723 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.249740 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.252252 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.256227 (+ 3975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.256242 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.256247 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.256663 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.257030 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.257033 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.257036 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.257203 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.257740 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.257746 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.257965 (+ 219us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.258167 (+ 202us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.258439 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":430,"threads_started":1}
I20260923 19:36:12.260116 19785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192172, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.252@KRBTEST.COM for oryx/127.12.159.253@KRBTEST.COM
I20260923 19:36:12.274264 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.260864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.0.0.1:44498)
0923 19:36:12.261058 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.261082 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.261182 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.261954 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.261957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.262289 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.262439 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.262446 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.263772 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.263777 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.264982 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.264995 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.265708 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.265712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.265923 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.266697 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.266714 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.268861 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.271893 (+ 3032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.271897 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.271900 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.272291 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.272624 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.272627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.272629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.272759 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.273287 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.273291 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.273427 (+ 136us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.273572 (+ 145us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.273891 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 19:36:12.274319 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.260978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44498 (local address 127.12.159.253:33685)
0923 19:36:12.261594 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.261598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.261614 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:36:12.261674 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.261677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.261732 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.261913 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.262571 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.263603 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.265141 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.265570 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.265684 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.269071 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.269077 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.269082 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.269129 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.271760 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.272398 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.272401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.272404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.272528 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.272881 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.272889 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.272892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.273168 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.273335 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.273657 (+ 322us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.273891 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":374,"threads_started":1}
I20260923 19:36:12.275653 19785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:36:12.275815 19791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:12.276230 19791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192172, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.252@KRBTEST.COM for oryx/127.12.159.252@KRBTEST.COM
I20260923 19:36:12.290103 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.276426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44512 (local address 127.12.159.253:33685)
0923 19:36:12.276744 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.276752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.284327 (+ 7575us) server_negotiation.cc:407] Connection header received
0923 19:36:12.284543 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.284554 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.284638 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.284759 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:12.285317 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.286476 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.288195 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.289054 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.289252 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.289473 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.289683 (+ 210us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.289834 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260923 19:36:12.290154 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.275916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.0.0.1:44512)
0923 19:36:12.284222 (+ 8306us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.284252 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.284387 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.284797 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.284804 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.284831 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:12.285078 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.285091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.286645 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.286649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.288036 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.288048 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.289242 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.289248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.289466 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.289530 (+ 64us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.289660 (+ 130us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.289854 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8110,"thread_start_us":7939,"threads_started":1}
I20260923 19:36:12.291338 19707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ae18a6683f4428ea5a5393ff709e6b1. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:12.291620 19707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:36:12.292332 19792 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: attempting to promote NON_VOTER 5f284bb429c04c698b34668f80de70c7 to VOTER
I20260923 19:36:12.293355 19792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } }
I20260923 19:36:12.294363 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.276777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55268 (local address 127.12.159.252:41375)
0923 19:36:12.276980 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.276988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.278155 (+ 1167us) server_negotiation.cc:407] Connection header received
0923 19:36:12.278395 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.278403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.278480 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.278554 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.279828 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.281358 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.283734 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.284420 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.284574 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.287971 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.287976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.287979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.288005 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.291315 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.292085 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.292090 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.292093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.292262 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.292693 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.292698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.292701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.293038 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.293191 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.293629 (+ 438us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.293967 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":60}
I20260923 19:36:12.294386 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.276436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.0.0.1:55268)
0923 19:36:12.278054 (+ 1618us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.278075 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.278258 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.278788 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.278795 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.279406 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.279653 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.279668 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.281672 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.281680 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.283533 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.283549 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.284587 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.284592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.284776 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.285398 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.285422 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.287797 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.291471 (+ 3674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.291476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.291480 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.291949 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.292376 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.292380 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.292382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.292569 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.293198 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.293203 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.293350 (+ 147us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.293473 (+ 123us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.293765 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1445}
I20260923 19:36:12.295310 19679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 LEARNER]: Refusing update from remote peer 9ae18a6683f4428ea5a5393ff709e6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260923 19:36:12.295951 19792 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260923 19:36:12.299166 19793 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 5f284bb429c04c698b34668f80de70c7 (127.12.159.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } }
I20260923 19:36:12.300002 19785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Bootstrap starting.
I20260923 19:36:12.299832 19679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 5f284bb429c04c698b34668f80de70c7 (127.12.159.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } }
I20260923 19:36:12.302964 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } }
I20260923 19:36:12.303206 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:12.303122 19707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } }
I20260923 19:36:12.303395 19707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:12.303601 19791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } }
I20260923 19:36:12.303844 19791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:12.304270 19785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:12.305295 19785 log.cc:824] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:12.308208 19785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: No bootstrap required, opened a new log
I20260923 19:36:12.315229 19785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } }
I20260923 19:36:12.315539 19785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:12.315683 19785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8854a52e27364d7094151c6aec4ce0eb, State: Initialized, Role: FOLLOWER
I20260923 19:36:12.316380 19785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } }
I20260923 19:36:12.317265 19798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } } }
I20260923 19:36:12.317739 19798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:12.318353 19785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:36:12.327589 19809 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:36:12.327757 19809 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:36:12.331666 19625 master_runner.cc:428] Detected that this master 8854a52e27364d7094151c6aec4ce0eb is joining an existing cluster
I20260923 19:36:12.331766 19625 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.159.252:41375
I20260923 19:36:12.359073 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 19124
I20260923 19:36:12.365986 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.336413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49308 (local address 127.12.159.254:36803)
0923 19:36:12.336649 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.336658 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.341216 (+ 4558us) server_negotiation.cc:407] Connection header received
0923 19:36:12.341521 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.341530 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.341664 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.341745 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.343733 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.345254 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.349066 (+ 3812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.350071 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.350209 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.353749 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.353757 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.353761 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.353827 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.357782 (+ 3955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.358581 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.358598 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.358602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.358767 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.359278 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.359284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.359287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.359647 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.359794 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.365297 (+ 5503us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.365548 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:36:12.367810 19798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:12.368249 19798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } }
I20260923 19:36:12.369045 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.341416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55272 (local address 127.12.159.252:41375)
0923 19:36:12.341603 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.341609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.351757 (+ 10148us) server_negotiation.cc:407] Connection header received
0923 19:36:12.352147 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.352156 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.352229 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.352302 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.353765 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.354862 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.356848 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.357531 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.357636 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.360130 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.360149 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.360154 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.360385 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.364681 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.365481 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.365486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.365490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.365638 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.366067 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.366072 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.366075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.366600 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.366738 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.368161 (+ 1423us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.368424 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":65,"spinlock_wait_cycles":403712}
I20260923 19:36:12.369472 19817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.341782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.0.0.1:55272)
0923 19:36:12.351671 (+ 9889us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.351691 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.351993 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.352511 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.352516 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.353245 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.353615 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.353627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.355051 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.355055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.356691 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.356705 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.357967 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.357973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.358147 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.358786 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.358808 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.359952 (+ 1144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.364794 (+ 4842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.364800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.364803 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.365316 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.365752 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.365757 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.365760 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.365949 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.366818 (+ 869us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.366822 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.367014 (+ 192us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.367138 (+ 124us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.367426 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9717,"mutex_wait_us":40,"thread_start_us":9970,"threads_started":1}
I20260923 19:36:12.370107 19798 leader_election.cc:288] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803), 5f284bb429c04c698b34668f80de70c7 (127.12.159.253:33685)
I20260923 19:36:12.370939 19072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8854a52e27364d7094151c6aec4ce0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" is_pre_election: true
I20260923 19:36:12.371500 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8854a52e27364d7094151c6aec4ce0eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f284bb429c04c698b34668f80de70c7" is_pre_election: true
I20260923 19:36:12.372454 19736 leader_election.cc:302] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8854a52e27364d7094151c6aec4ce0eb; no voters: 5f284bb429c04c698b34668f80de70c7, 9ae18a6683f4428ea5a5393ff709e6b1
I20260923 19:36:12.372893 19798 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:36:12.374287 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.336064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44526 (local address 127.12.159.253:33685)
0923 19:36:12.336275 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.336281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.348820 (+ 12539us) server_negotiation.cc:407] Connection header received
0923 19:36:12.349005 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.349013 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.349114 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.349226 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.350810 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.351888 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.354152 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.354853 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.354965 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.361934 (+ 6969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.361941 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.361946 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.361989 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.365509 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.366752 (+ 1243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.366758 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.366761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.366936 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.367812 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.367817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.367822 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.368196 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.368335 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.373578 (+ 5243us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.373892 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.193@KRBTEST.COM
I20260923 19:36:12.375509 19816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.336063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.0.0.1:44526)
0923 19:36:12.348664 (+ 12601us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.348691 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.348850 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.349407 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.349412 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.350251 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.350596 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.350609 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.352151 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.352159 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.353976 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.353990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.355364 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.355372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.355621 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.356415 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.356440 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.361682 (+ 5242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.365691 (+ 4009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.365696 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.365701 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.366628 (+ 927us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.367102 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.367110 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.367116 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.367369 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.368597 (+ 1228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.368603 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.373253 (+ 4650us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.373406 (+ 153us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.375079 (+ 1673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12393,"mutex_wait_us":1358,"thread_start_us":12135,"threads_started":1}
I20260923 19:36:12.376085 19815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.335975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49308)
0923 19:36:12.341080 (+ 5105us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.341103 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.341347 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.342097 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.342105 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.343009 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.343490 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.343506 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.345500 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.345509 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.347895 (+ 2386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.347916 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.350761 (+ 2845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.350769 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.351041 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.351964 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.351990 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.353498 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.357952 (+ 4454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.357957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.357962 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.358433 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.358919 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.358925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.358928 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.359140 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.359884 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.359889 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.364915 (+ 5026us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.366256 (+ 1341us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.373644 (+ 7388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4958,"mutex_wait_us":24,"thread_start_us":4818,"threads_started":1}
I20260923 19:36:12.384596 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.360580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47726 (local address 127.12.159.193:43583)
0923 19:36:12.361298 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.361307 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.361339 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:36:12.361407 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.361415 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.361705 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.363631 (+ 1926us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.363915 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.367166 (+ 3251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.369224 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.370187 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.374131 (+ 3944us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.375913 (+ 1782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.375926 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.375940 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.376007 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.380971 (+ 4964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.381950 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.381961 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.381966 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.382131 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.382598 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.382603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.382606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.382951 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.383268 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.383903 (+ 635us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.384184 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":359,"threads_started":1}
I20260923 19:36:12.386072 19247 generic_service.cc:196] Checking for leaks (request via RPC)
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192169, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.254@KRBTEST.COM for oryx/127.12.159.252@KRBTEST.COM
I20260923 19:36:12.405145 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.381219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.0.0.1:55276)
0923 19:36:12.381404 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.381425 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.381530 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.382232 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.382237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.382715 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.382908 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.382921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.384385 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.384390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.385487 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.385500 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.386899 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.386908 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.387160 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.387986 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.388017 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.396828 (+ 8811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.402205 (+ 5377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.402212 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.402216 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.402765 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.403309 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.403315 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.403318 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.403496 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.404132 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.404137 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.404334 (+ 197us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.404462 (+ 128us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.404744 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260923 19:36:12.406282 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.381579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55276 (local address 127.12.159.252:41375)
0923 19:36:12.381793 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.381799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.381849 (+ 50us) server_negotiation.cc:407] Connection header received
0923 19:36:12.381938 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.381943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.382060 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.382168 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.383075 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.384233 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.385642 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.386443 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.386599 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.397117 (+ 10518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.397129 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.397137 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.397193 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.402015 (+ 4822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.402938 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.402944 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.402947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.403078 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.403628 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.403633 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.403637 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.403981 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.405519 (+ 1538us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.405695 (+ 176us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.405942 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 19:36:12.407655 19062 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.159.252:41375: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb"
member_type: NON_VOTER
last_known_addr {
host: "127.12.159.252"
port: 41375
}
attrs {
promote: true
}
}
dest_uuid: "9ae18a6683f4428ea5a5393ff709e6b1"
cas_config_opid_index: 6
I20260923 19:36:12.408437 19062 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } }
I20260923 19:36:12.410620 19679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Refusing update from remote peer 9ae18a6683f4428ea5a5393ff709e6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260923 19:36:12.411361 19792 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260923 19:36:12.413038 19760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:12.416698 19760 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Refusing update from remote peer 9ae18a6683f4428ea5a5393ff709e6b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260923 19:36:12.418264 19792 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:12.419463 19791 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.426800 19679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.431043 19707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.431357 19707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:12.431696 19791 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.159.252:41375
I20260923 19:36:12.432420 19625 master.cc:537] Master@127.12.159.252:41375 shutting down...
I20260923 19:36:12.431216 19759 raft_consensus.cc:858] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } }
W20260923 19:36:12.433326 19759 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } }
I20260923 19:36:12.433480 19791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.435768 19791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:12.436305 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.436640 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:12.480379 19759 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5f284bb429c04c698b34668f80de70c7 (127.12.159.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:12.485162 19825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:12.485646 19798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ae18a6683f4428ea5a5393ff709e6b1. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:12.485924 19798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260923 19:36:12.485648 19825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260923 19:36:12.485982 19822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: NON_VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: true } } }
I20260923 19:36:12.486335 19822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260923 19:36:12.488633 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.488940 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:12.489180 19625 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260923 19:36:12.489678 19625 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260923 19:36:12.489887 19625 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: stopping tablet replica
W20260923 19:36:12.490183 19046 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260923 19:36:12.496703 19046 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 -> Peer 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252:41375): Couldn't send request to peer 8854a52e27364d7094151c6aec4ce0eb. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:36:12.508208 19625 master.cc:552] Master@127.12.159.252:41375 shutdown complete.
I20260923 19:36:12.508303 19625 master_runner.cc:305] Clearing existing system tablet
I20260923 19:36:12.508711 19625 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:12.508832 19625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:12.512271 19625 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 19:36:12.513000 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 19124
I20260923 19:36:12.518229 19828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:12.518679 19625 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:12.518936 19625 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.003s
I20260923 19:36:12.519042 19625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
uuid: "8854a52e27364d7094151c6aec4ce0eb"
format_stamp: "Formatted at 2026-09-23 19:36:12 on dist-test-slave-lzv7"
server_key: "2280d5c978117b42c07a09ac248b3dba"
server_key_iv: "101033cc99f67531d79e1fe9b4c1f57e"
server_key_version: "encryptionkey@0"
I20260923 19:36:12.528736 19625 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:12.535240 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:43583
--local_ip_for_outbound_sockets=127.12.159.193
--tserver_master_addrs=127.12.159.254:36803
--webserver_port=41625
--webserver_interface=127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab
--principal=oryx/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:36:12.536072 19625 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 19:36:12.536274 19625 log.cc:1196] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260923 19:36:12.536780 19625 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Deleting consensus metadata
I20260923 19:36:12.537066 19625 master_runner.cc:315] Copying system tablet from 127.12.159.254:36803
I20260923 19:36:12.544360 19625 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: tablet copy: Beginning tablet copy session from remote peer at address 127.12.159.254:36803
I20260923 19:36:12.562381 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.545671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49318 (local address 127.12.159.254:36803)
0923 19:36:12.546099 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.546109 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.550363 (+ 4254us) server_negotiation.cc:407] Connection header received
0923 19:36:12.550570 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.550575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.550644 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.550756 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:12.551747 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.552572 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.554100 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.554528 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.554662 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.556767 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:12.556772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:12.556775 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:12.556805 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:12.559654 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.560340 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.560346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.560350 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.560483 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:12.560884 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:12.560889 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:12.560892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:12.561161 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:12.561322 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.561747 (+ 425us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.561999 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265}
I20260923 19:36:12.562580 19835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.545229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49318)
0923 19:36:12.550233 (+ 5004us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.550259 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.550434 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.550830 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.550834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.551391 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:12.551595 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.551604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.552750 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.552755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.553967 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.553979 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.554708 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.554714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.554897 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.555770 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:12.555788 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:12.556565 (+ 777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:12.559812 (+ 3247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.559817 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.559822 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.560212 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.560594 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:12.560600 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:12.560604 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:12.560759 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:12.561289 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:12.561294 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:12.561482 (+ 188us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.561643 (+ 161us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.561999 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4876,"thread_start_us":4778,"threads_started":1}
I20260923 19:36:12.563508 19082 tablet_copy_service.cc:140] P 9ae18a6683f4428ea5a5393ff709e6b1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8854a52e27364d7094151c6aec4ce0eb ({username='oryx', principal='oryx/127.12.159.252@KRBTEST.COM'} at 127.0.0.1:49318)
I20260923 19:36:12.563678 19082 tablet_copy_service.cc:161] P 9ae18a6683f4428ea5a5393ff709e6b1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8854a52e27364d7094151c6aec4ce0eb at {username='oryx', principal='oryx/127.12.159.252@KRBTEST.COM'} at 127.0.0.1:49318: session id = 8854a52e27364d7094151c6aec4ce0eb-00000000000000000000000000000000
I20260923 19:36:12.566331 19082 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 19:36:12.568140 19625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 19:36:12.573190 19625 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: tablet copy: Starting download of 0 data blocks...
I20260923 19:36:12.573494 19625 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: tablet copy: Starting download of 1 WAL segments...
I20260923 19:36:12.575855 19625 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 19:36:12.579106 19082 tablet_copy_service.cc:342] P 9ae18a6683f4428ea5a5393ff709e6b1: Request end of tablet copy session 8854a52e27364d7094151c6aec4ce0eb-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.159.252@KRBTEST.COM'} at 127.0.0.1:49318
I20260923 19:36:12.579262 19082 tablet_copy_service.cc:433] P 9ae18a6683f4428ea5a5393ff709e6b1: ending tablet copy session 8854a52e27364d7094151c6aec4ce0eb-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8854a52e27364d7094151c6aec4ce0eb
I20260923 19:36:12.589607 19625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:12.592686 19836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:12.598641 19837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:12.602447 19839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:12.602649 19625 server_base.cc:1034] running on GCE node
I20260923 19:36:12.603178 19625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:12.603811 19625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:12.605011 19625 hybrid_clock.cc:648] HybridClock initialized: now 1790192172604969 us; error 34 us; skew 500 ppm
I20260923 19:36:12.605253 19625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:12 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192172, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:12.607199 19625 init.cc:377] Logged in from keytab as oryx/127.12.159.252@KRBTEST.COM (short username oryx)
I20260923 19:36:12.608467 19625 webserver.cc:460] Webserver started at http://127.12.159.252:46363/ using document root <none> and password file <none>
I20260923 19:36:12.608789 19625 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:12.608901 19625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:12.611461 19625 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260923 19:36:12.613019 19846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:12.613440 19625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 19:36:12.613566 19625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
uuid: "8854a52e27364d7094151c6aec4ce0eb"
format_stamp: "Formatted at 2026-09-23 19:36:12 on dist-test-slave-lzv7"
server_key: "2280d5c978117b42c07a09ac248b3dba"
server_key_iv: "101033cc99f67531d79e1fe9b4c1f57e"
server_key_version: "encryptionkey@0"
I20260923 19:36:12.613790 19625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:12.635752 19625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:12.639283 19625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:12.673123 19625 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.252:41375
I20260923 19:36:12.673141 19897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.252:41375 every 8 connection(s)
I20260923 19:36:12.674220 19625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
I20260923 19:36:12.685662 19898 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:36:12.691547 19898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Bootstrap starting.
I20260923 19:36:12.703624 19898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:36:12.704123 19898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: Bootstrap complete.
I20260923 19:36:12.705022 19898 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } }
I20260923 19:36:12.705379 19898 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8854a52e27364d7094151c6aec4ce0eb, State: Initialized, Role: LEARNER
I20260923 19:36:12.705614 19898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } }
I20260923 19:36:12.706454 19901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.706843 19898 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:12.706950 19901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: LEARNER
I20260923 19:36:12.716944 19912 catalog_manager.cc:1259] Loaded cluster ID: a8f6e8f7ceda4222bca1e99e22e5b3a4
I20260923 19:36:12.717082 19912 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: loading cluster ID for follower catalog manager: success
I20260923 19:36:12.719580 19912 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: acquiring CA information for follower catalog manager: success
I20260923 19:36:12.721472 19912 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 19:36:12.951767 19832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:12.952047 19832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:12.952198 19832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:12.960131 19832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:12.960283 19832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:12.960464 19832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:12.971483 19832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab
--principal=oryx/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:43583
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=41625
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:12.972955 19832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:12.974303 19832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 19:36:12.977646 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.978008 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:12.985121 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.978182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55282 (local address 127.12.159.252:41375)
0923 19:36:12.979016 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:12.979023 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:12.979043 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:36:12.979118 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:12.979123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:12.979215 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:12.979358 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:12.979719 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.981129 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.983271 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.984069 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.984294 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.984484 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:12.984656 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 19:36:12.984781 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":557,"threads_started":1}
I20260923 19:36:12.985126 19916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:12.978072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.0.0.1:55282)
0923 19:36:12.978616 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:12.978654 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:12.978809 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:12.979391 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:12.979394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:12.979416 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:12.979579 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.979586 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.981261 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.981265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.983115 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:12.983130 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:12.984270 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:12.984278 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:12.984481 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:12.984526 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 19:36:12.984624 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 19:36:12.984766 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":314,"threads_started":1}
I20260923 19:36:12.986541 19873 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260923 19:36:12.987049 19901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ae18a6683f4428ea5a5393ff709e6b1. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: NON_VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: true } } }
I20260923 19:36:12.987407 19901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: LEARNER
I20260923 19:36:12.987865 19792 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: attempting to promote NON_VOTER 8854a52e27364d7094151c6aec4ce0eb to VOTER
I20260923 19:36:12.988672 19792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:12.990887 19873 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 LEARNER]: Refusing update from remote peer 9ae18a6683f4428ea5a5393ff709e6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260923 19:36:12.991582 19679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Refusing update from remote peer 9ae18a6683f4428ea5a5393ff709e6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20260923 19:36:12.991650 19922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:12.991959 19791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260923 19:36:12.991652 19920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:12.992753 19791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260923 19:36:12.994807 19919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:12.995513 19793 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:12.996666 19679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:12.997224 19832 server_base.cc:1034] running on GCE node
I20260923 19:36:12.997624 19873 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:12.998189 19832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:12.999495 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:12.999722 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:12.999912 19792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:13.000150 19792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:13.000516 19792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:13.000778 19792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:13.001518 19901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:13.001917 19901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:13.006422 19927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:13.007048 19927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:13.007767 19832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:13.009013 19832 hybrid_clock.cc:648] HybridClock initialized: now 1790192173008951 us; error 51 us; skew 500 ppm
I20260923 19:36:13.009454 19832 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:13.019667 19832 init.cc:377] Logged in from keytab as oryx/127.12.159.193@KRBTEST.COM (short username oryx)
I20260923 19:36:13.021315 19832 webserver.cc:460] Webserver started at http://127.12.159.193:41625/ using document root <none> and password file <none>
I20260923 19:36:13.022073 19832 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:13.022186 19832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:13.027832 19832 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260923 19:36:13.030808 19932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:13.032537 19832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:36:13.032680 19832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "6ec1339286574c59a237f1790aae02e3"
format_stamp: "Formatted at 2026-09-23 19:36:09 on dist-test-slave-lzv7"
server_key: "553ba6b6ae135e9ce2aa9c3efb533dd0"
server_key_iv: "0799e9d05f36ed0acc247626fa11e24c"
server_key_version: "encryptionkey@0"
I20260923 19:36:13.033758 19832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:13.049450 19832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:13.054070 19832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:13.054317 19832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:13.055258 19832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:13.056753 19832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:13.056845 19832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:13.056918 19832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:13.056967 19832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:13.093150 19832 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:43583
I20260923 19:36:13.093195 20044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:43583 every 8 connection(s)
I20260923 19:36:13.094702 19832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:13.103404 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 19832
I20260923 19:36:13.103746 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 19258
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.253@KRBTEST.COM
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.252@KRBTEST.COM
I20260923 19:36:13.130383 20049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.097944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:44935 (local address 127.12.159.253:33685)
0923 19:36:13.099171 (+ 1227us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.099180 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.099943 (+ 763us) server_negotiation.cc:407] Connection header received
0923 19:36:13.103001 (+ 3058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.103006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.103090 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.103211 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.106701 (+ 3490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.108330 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.112404 (+ 4074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.113253 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.113454 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.120642 (+ 7188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.120653 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.120660 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.120716 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.125102 (+ 4386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.126422 (+ 1320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.126431 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.126437 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.126619 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.127227 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.127232 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.127235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.127745 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.127915 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.129033 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.129359 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1023,"thread_start_us":864,"threads_started":1}
I20260923 19:36:13.131587 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.100417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:33113)
0923 19:36:13.101035 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:13.101062 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:13.102538 (+ 1476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:13.103558 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:13.103570 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:13.104835 (+ 1265us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:13.106378 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.106430 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.108777 (+ 2347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.108786 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.112178 (+ 3392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.112201 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.114553 (+ 2352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.114561 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.114855 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.115733 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:13.115773 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:13.119733 (+ 3960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:13.125251 (+ 5518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.125262 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.125282 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.126203 (+ 921us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.126720 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.126727 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.126733 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.127078 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.127896 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:13.127907 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:13.128462 (+ 555us) client_negotiation.cc:769] Sending connection context
0923 19:36:13.128843 (+ 381us) client_negotiation.cc:240] Negotiation successful
0923 19:36:13.129530 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":295,"spinlock_wait_cycles":43136,"thread_start_us":330,"threads_started":1}
I20260923 19:36:13.131865 20050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.098646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.12.159.193:44935)
0923 19:36:13.099765 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:13.099820 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:13.102541 (+ 2721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:13.103556 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:13.103570 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:13.104836 (+ 1266us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:13.106423 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.106445 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.108674 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.108683 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.112174 (+ 3491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.112199 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.114003 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.114013 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.114463 (+ 450us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.115624 (+ 1161us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:13.115673 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:13.120356 (+ 4683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:13.125305 (+ 4949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.125313 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.125319 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.126249 (+ 930us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.126804 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.126811 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.126817 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.127075 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.128016 (+ 941us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:13.128024 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:13.128489 (+ 465us) client_negotiation.cc:769] Sending connection context
0923 19:36:13.130639 (+ 2150us) client_negotiation.cc:240] Negotiation successful
0923 19:36:13.131185 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"mutex_wait_us":376,"spinlock_wait_cycles":26752,"thread_start_us":385,"threads_started":1}
I20260923 19:36:13.133571 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.100559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:33113 (local address 127.12.159.254:36803)
0923 19:36:13.102265 (+ 1706us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.102272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.102295 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:36:13.103015 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.103022 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.103116 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.103778 (+ 662us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.106707 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.108543 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.112456 (+ 3913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.114082 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.117730 (+ 3648us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.120094 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.120102 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.120108 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.120155 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.125055 (+ 4900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.126380 (+ 1325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.126389 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.126396 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.126564 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.127252 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.127258 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.127262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.127712 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.132617 (+ 4905us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.132778 (+ 161us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.133055 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1536,"thread_start_us":1425,"threads_started":1}
I20260923 19:36:13.133780 20047 heartbeater.cc:347] Connected to a master server at 127.12.159.253:33685
I20260923 19:36:13.134184 20047 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:13.134783 20046 heartbeater.cc:347] Connected to a master server at 127.12.159.254:36803
I20260923 19:36:13.134929 20046 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:13.135450 20047 heartbeater.cc:511] Master 127.12.159.253:33685 requested a full tablet report, sending...
I20260923 19:36:13.135473 20046 heartbeater.cc:511] Master 127.12.159.254:36803 requested a full tablet report, sending...
I20260923 19:36:13.135785 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.098269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:57023 (local address 127.12.159.252:41375)
0923 19:36:13.098479 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.098486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.099943 (+ 1457us) server_negotiation.cc:407] Connection header received
0923 19:36:13.102918 (+ 2975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.102928 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.103021 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.103098 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.116366 (+ 13268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.117566 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.119569 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.120348 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.120497 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.125639 (+ 5142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.125646 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.125651 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.125694 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.131160 (+ 5466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.132970 (+ 1810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.132976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.132980 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.133149 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.133714 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.133722 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.133728 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.134160 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.134341 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.135094 (+ 753us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.135377 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 19:36:13.136897 20051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.098647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.12.159.193:57023)
0923 19:36:13.099765 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:13.099820 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:13.102545 (+ 2725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:13.103556 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:13.103570 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:13.110995 (+ 7425us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:13.115477 (+ 4482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.115499 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.117761 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.117766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.119320 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.119336 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.120798 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.120807 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.121064 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.122083 (+ 1019us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:13.122112 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:13.125379 (+ 3267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:13.131560 (+ 6181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.131572 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.131580 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.132462 (+ 882us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.133317 (+ 855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.133324 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.133329 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.133508 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.134428 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:13.134432 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:13.134734 (+ 302us) client_negotiation.cc:769] Sending connection context
0923 19:36:13.136060 (+ 1326us) client_negotiation.cc:240] Negotiation successful
0923 19:36:13.136392 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":972,"mutex_wait_us":1440,"spinlock_wait_cycles":91904,"thread_start_us":624,"threads_started":1}
I20260923 19:36:13.137898 20045 heartbeater.cc:347] Connected to a master server at 127.12.159.252:41375
I20260923 19:36:13.137884 19062 ts_manager.cc:194] Re-registered known tserver with Master: 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583)
I20260923 19:36:13.138019 20045 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:13.138418 20045 heartbeater.cc:511] Master 127.12.159.252:41375 requested a full tablet report, sending...
I20260923 19:36:13.138911 19669 ts_manager.cc:194] Registered new tserver with Master: 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583)
I20260923 19:36:13.138998 19062 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:33113
I20260923 19:36:13.140072 19863 ts_manager.cc:194] Registered new tserver with Master: 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583)
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.194@KRBTEST.COM
I20260923 19:36:13.157792 20055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.104935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43352 (local address 127.12.159.194:34749)
0923 19:36:13.121921 (+ 16986us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.121935 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.139792 (+ 17857us) server_negotiation.cc:407] Connection header received
0923 19:36:13.139989 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.139998 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.140302 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.140481 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.142584 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.143577 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.145075 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.145623 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.145729 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.151079 (+ 5350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.151090 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.151104 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.151154 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.154623 (+ 3469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.155492 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.155499 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.155502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.155646 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.156135 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.156139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.156141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.156520 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.156848 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.157139 (+ 291us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.157430 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16710,"thread_start_us":19477,"threads_started":1}
I20260923 19:36:13.159133 19381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:13.243500 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 19258
I20260923 19:36:13.260042 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:34749
--local_ip_for_outbound_sockets=127.12.159.194
--tserver_master_addrs=127.12.159.254:36803
--webserver_port=41037
--webserver_interface=127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab
--principal=oryx/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:13.589408 20057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:13.589754 20057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:13.589929 20057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:13.597151 20057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:13.597327 20057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:13.597517 20057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:13.607443 20057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab
--principal=oryx/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:34749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=41037
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:13.608805 20057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:13.610235 20057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:13.623677 20062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:13.623636 20063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:13.623600 20065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:13.624505 20057 server_base.cc:1034] running on GCE node
I20260923 19:36:13.625090 20057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:13.626050 20057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:13.627278 20057 hybrid_clock.cc:648] HybridClock initialized: now 1790192173627241 us; error 49 us; skew 500 ppm
I20260923 19:36:13.627586 20057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:13.630920 20057 init.cc:377] Logged in from keytab as oryx/127.12.159.194@KRBTEST.COM (short username oryx)
I20260923 19:36:13.632359 20057 webserver.cc:460] Webserver started at http://127.12.159.194:41037/ using document root <none> and password file <none>
I20260923 19:36:13.633065 20057 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:13.633211 20057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:13.638832 20057 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:36:13.641556 20072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:13.643108 20057 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:36:13.643280 20057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "1bd59290fd3b46e2bcd3bbb61c123a58"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "a64ad3aab92786b82c7d12e89013c0fd"
server_key_iv: "e25789a4ec3cc53d3a9f0fb1b29d14ac"
server_key_version: "encryptionkey@0"
I20260923 19:36:13.644321 20057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:13.665598 20057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:13.670617 20057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:13.670943 20057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:13.672104 20057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:13.673957 20057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:13.674064 20057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:13.674209 20057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:13.674317 20057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:13.708729 20057 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:34749
I20260923 19:36:13.708803 20184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:34749 every 8 connection(s)
I20260923 19:36:13.710304 20057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:13.713351 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 20057
I20260923 19:36:13.713697 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 19391
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.195@KRBTEST.COM
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.252@KRBTEST.COM
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.253@KRBTEST.COM
I20260923 19:36:13.750074 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.713427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:42517 (local address 127.12.159.252:41375)
0923 19:36:13.727095 (+ 13668us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.727104 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.727128 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:36:13.727197 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.727205 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.727299 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.727444 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.729851 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.731447 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.734983 (+ 3536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.735943 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.736086 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.742683 (+ 6597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.742693 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.742700 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.742746 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.745993 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.746989 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.746997 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.747002 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.747160 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.747772 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.747778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.747783 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.748137 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.748263 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.749385 (+ 1122us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.749629 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13499,"thread_start_us":13370,"threads_started":1}
I20260923 19:36:13.752017 20193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.716090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.12.159.195:33811)
0923 19:36:13.724447 (+ 8357us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.724460 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.724500 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:36:13.724601 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.724612 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.724911 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.725093 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.728813 (+ 3720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.730246 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.732810 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.733710 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.738192 (+ 4482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.742894 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.742913 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.742936 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.742978 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.747450 (+ 4472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.748582 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.748593 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.748598 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.748809 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.749249 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.749254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.749258 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.749680 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.751122 (+ 1442us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.751294 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.751566 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8041,"thread_start_us":7828,"threads_started":1}
I20260923 19:36:13.752663 20196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.714050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.12.159.194:60009)
0923 19:36:13.726421 (+ 12371us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:13.726445 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:13.726582 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:13.733391 (+ 6809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:13.733395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:13.734140 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:13.734484 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.734504 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.736211 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.736218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.738035 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.738053 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.739464 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.739471 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.739665 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.740284 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:13.740308 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:13.743002 (+ 2694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:13.748875 (+ 5873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.748880 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.748883 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.749400 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.749859 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.749864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.749868 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.750032 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.750954 (+ 922us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:13.750962 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:13.751117 (+ 155us) client_negotiation.cc:769] Sending connection context
0923 19:36:13.751254 (+ 137us) client_negotiation.cc:240] Negotiation successful
0923 19:36:13.751503 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12175,"mutex_wait_us":6385,"thread_start_us":5596,"threads_started":1}
I20260923 19:36:13.752686 20190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.714050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.12.159.194:42517)
0923 19:36:13.715188 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:13.715258 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:13.718452 (+ 3194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:13.727759 (+ 9307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:13.727771 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:13.728769 (+ 998us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:13.729594 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.729626 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.731780 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.731789 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.734765 (+ 2976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.734785 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.736620 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.736630 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.737080 (+ 450us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.738094 (+ 1014us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:13.738136 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:13.742353 (+ 4217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:13.746168 (+ 3815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.746177 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.746196 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.746833 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.747325 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.747344 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.747348 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.747634 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.748390 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:13.748398 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:13.748875 (+ 477us) client_negotiation.cc:769] Sending connection context
0923 19:36:13.750452 (+ 1577us) client_negotiation.cc:240] Negotiation successful
0923 19:36:13.751100 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"mutex_wait_us":7,"thread_start_us":4475,"threads_started":1}
I20260923 19:36:13.753559 20191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.714398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:60009 (local address 127.12.159.253:33685)
0923 19:36:13.732979 (+ 18581us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.732985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.733002 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:36:13.733056 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.733062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.733137 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.734673 (+ 1536us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.734869 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.736026 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.738574 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.739238 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.740017 (+ 779us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.743222 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.743228 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.743233 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.743269 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.748706 (+ 5437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.749548 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.749556 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.749560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.749690 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.750184 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.750189 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.750192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.750802 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.753000 (+ 2198us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.753149 (+ 149us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.753324 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18454,"thread_start_us":18824,"threads_started":1}
Sep 23 19:36:13 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192173, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:13.754627 19514 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:13.755247 20185 heartbeater.cc:347] Connected to a master server at 127.12.159.252:41375
I20260923 19:36:13.755499 20185 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:13.756436 20185 heartbeater.cc:511] Master 127.12.159.252:41375 requested a full tablet report, sending...
I20260923 19:36:13.757288 20187 heartbeater.cc:347] Connected to a master server at 127.12.159.253:33685
I20260923 19:36:13.757434 20187 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:13.757880 20187 heartbeater.cc:511] Master 127.12.159.253:33685 requested a full tablet report, sending...
I20260923 19:36:13.758652 19863 ts_manager.cc:194] Registered new tserver with Master: 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749)
I20260923 19:36:13.759027 19669 ts_manager.cc:194] Registered new tserver with Master: 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749)
I20260923 19:36:13.761569 20195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.719998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:51987 (local address 127.12.159.254:36803)
0923 19:36:13.742098 (+ 22100us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:13.742106 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:13.742127 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:36:13.742191 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:13.742196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:13.742277 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:13.745790 (+ 3513us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:13.745997 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.747068 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.749077 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.749680 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.752632 (+ 2952us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.754693 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:13.754699 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:13.754705 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:13.754753 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:13.758768 (+ 4015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.759592 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.759597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.759600 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.759746 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:13.760276 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:13.760280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:13.760282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:13.760549 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:13.760651 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:13.761173 (+ 522us) server_negotiation.cc:299] Negotiation successful
0923 19:36:13.761326 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21945,"thread_start_us":25176,"threads_started":1}
I20260923 19:36:13.762126 20194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:13.719851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:51987)
0923 19:36:13.720532 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:13.720564 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:13.720724 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:13.744677 (+ 23953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:13.744686 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:13.745247 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:13.745624 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.745638 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.747235 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.747240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.748852 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:13.748868 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:13.749939 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:13.749946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:13.750143 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:13.750788 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:13.750813 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:13.754483 (+ 3670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:13.758938 (+ 4455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.758942 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.758945 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.759433 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.759897 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:13.759906 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:13.759913 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:13.760148 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:13.760686 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:13.760693 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:13.760913 (+ 220us) client_negotiation.cc:769] Sending connection context
0923 19:36:13.761097 (+ 184us) client_negotiation.cc:240] Negotiation successful
0923 19:36:13.761500 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":4934,"threads_started":1}
I20260923 19:36:13.763181 20186 heartbeater.cc:347] Connected to a master server at 127.12.159.254:36803
I20260923 19:36:13.763309 20186 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:13.763752 20186 heartbeater.cc:511] Master 127.12.159.254:36803 requested a full tablet report, sending...
I20260923 19:36:13.764813 19062 ts_manager.cc:194] Re-registered known tserver with Master: 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749)
I20260923 19:36:13.766422 19062 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:51987
I20260923 19:36:13.851666 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 19391
I20260923 19:36:13.867869 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:33811
--local_ip_for_outbound_sockets=127.12.159.195
--tserver_master_addrs=127.12.159.254:36803
--webserver_port=37805
--webserver_interface=127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab
--principal=oryx/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:36:14.142519 20046 heartbeater.cc:503] Master 127.12.159.254:36803 was elected leader, sending a full tablet report...
W20260923 19:36:14.217608 20198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:14.217996 20198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:14.218098 20198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:14.226073 20198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:14.226195 20198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:14.226320 20198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:14.236553 20198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab
--principal=oryx/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:33811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=37805
--tserver_master_addrs=127.12.159.254:36803,127.12.159.253:33685,127.12.159.252:41375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:14.238008 20198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:14.239410 20198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:14.253644 20203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:14.253585 20206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:14.253620 20204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:14.255335 20198 server_base.cc:1034] running on GCE node
I20260923 19:36:14.256067 20198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:14.257064 20198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:14.258256 20198 hybrid_clock.cc:648] HybridClock initialized: now 1790192174258190 us; error 65 us; skew 500 ppm
I20260923 19:36:14.258635 20198 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:14 dist-test-slave-lzv7 krb5kdc[19017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192174, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:14.261979 20198 init.cc:377] Logged in from keytab as oryx/127.12.159.195@KRBTEST.COM (short username oryx)
I20260923 19:36:14.263687 20198 webserver.cc:460] Webserver started at http://127.12.159.195:37805/ using document root <none> and password file <none>
I20260923 19:36:14.264456 20198 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:14.264612 20198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:14.270179 20198 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 19:36:14.272924 20213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:14.274345 20198 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:14.274575 20198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "dbb307c3048e491abf2eaf969fbdc021"
format_stamp: "Formatted at 2026-09-23 19:36:10 on dist-test-slave-lzv7"
server_key: "0ef9ef23422b700997e23a7c5c7a8d2a"
server_key_iv: "f99c708b409cde2c4a8a36c69d4f6679"
server_key_version: "encryptionkey@0"
I20260923 19:36:14.275547 20198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:14.293759 20198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:14.298122 20198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:14.298405 20198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:14.299381 20198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:14.300757 20198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:14.300881 20198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:14.301020 20198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:14.301108 20198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:14.335469 20198 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:33811
I20260923 19:36:14.335556 20325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:33811 every 8 connection(s)
I20260923 19:36:14.336941 20198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:14.346272 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 20198
Sep 23 19:36:14 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192174, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.253@KRBTEST.COM
Sep 23 19:36:14 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192174, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:14.400760 20333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.340887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.12.159.195:46749)
0923 19:36:14.350403 (+ 9516us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.350480 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.369979 (+ 19499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.372054 (+ 2075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.372062 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.372651 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:14.373751 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.373782 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.375400 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.375405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.377674 (+ 2269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.377685 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.378944 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.378954 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.379382 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.380283 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:14.380326 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:14.384079 (+ 3753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:14.392972 (+ 8893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:14.392977 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:14.392980 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:14.393971 (+ 991us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:14.395740 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:14.395744 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:14.395748 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:14.395925 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:14.396716 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:14.396726 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:14.397216 (+ 490us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.397527 (+ 311us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.398169 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9028,"mutex_wait_us":140,"spinlock_wait_cycles":58624,"thread_start_us":29406,"threads_started":1}
I20260923 19:36:14.400854 20335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.355554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:51049 (local address 127.12.159.254:36803)
0923 19:36:14.368632 (+ 13078us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.368643 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.370854 (+ 2211us) server_negotiation.cc:407] Connection header received
0923 19:36:14.371062 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.371070 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.371164 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.371252 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:14.374739 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.375813 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.381164 (+ 5351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.381877 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.382003 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.388636 (+ 6633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:14.388645 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:14.388653 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:14.388702 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:14.392643 (+ 3941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.394617 (+ 1974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.394624 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.394627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.394787 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.398615 (+ 3828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.398623 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.398627 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.399025 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:14.399180 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.400235 (+ 1055us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.400482 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12884,"thread_start_us":13083,"threads_started":1}
I20260923 19:36:14.402302 20331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.340238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:46749 (local address 127.12.159.253:33685)
0923 19:36:14.371681 (+ 31443us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.371690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.371711 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:36:14.371778 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.371785 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.371872 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.372623 (+ 751us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:14.374026 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.375207 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.377848 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.378638 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.379908 (+ 1270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.384358 (+ 4450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:14.384365 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:14.384372 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:14.384413 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:14.388613 (+ 4200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.395410 (+ 6797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.395417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.395422 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.395597 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.396071 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.396078 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.396083 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.396478 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:14.396631 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.401660 (+ 5029us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.401930 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31267,"thread_start_us":31152,"threads_started":1}
Sep 23 19:36:14 dist-test-slave-lzv7 krb5kdc[19017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192174, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.252@KRBTEST.COM
I20260923 19:36:14.403364 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.361606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:51049)
0923 19:36:14.370743 (+ 9137us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.370764 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.370895 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.371499 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.371503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.372792 (+ 1289us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:14.374545 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.374560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.376001 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.376005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.380626 (+ 4621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.380641 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.383278 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.383285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.383469 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.384194 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:14.384223 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:14.388403 (+ 4180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:14.392833 (+ 4430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:14.392847 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:14.392869 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:14.394471 (+ 1602us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:14.394962 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:14.394969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:14.394974 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:14.395236 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:14.399277 (+ 4041us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:14.399282 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:14.399455 (+ 173us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.401055 (+ 1600us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.402721 (+ 1666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8997,"mutex_wait_us":996,"spinlock_wait_cycles":2432,"thread_start_us":5905,"threads_started":1}
I20260923 19:36:14.404744 20328 heartbeater.cc:347] Connected to a master server at 127.12.159.253:33685
I20260923 19:36:14.404817 20327 heartbeater.cc:347] Connected to a master server at 127.12.159.254:36803
I20260923 19:36:14.405025 20328 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:14.406000 20328 heartbeater.cc:511] Master 127.12.159.253:33685 requested a full tablet report, sending...
I20260923 19:36:14.405032 20327 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:14.407426 20327 heartbeater.cc:511] Master 127.12.159.254:36803 requested a full tablet report, sending...
I20260923 19:36:14.408620 19062 ts_manager.cc:194] Re-registered known tserver with Master: dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811)
I20260923 19:36:14.409008 19669 ts_manager.cc:194] Registered new tserver with Master: dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811)
I20260923 19:36:14.410068 19062 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:51049
I20260923 19:36:14.420572 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.340093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:33893 (local address 127.12.159.252:41375)
0923 19:36:14.370454 (+ 30361us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.370463 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.370488 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:36:14.370560 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.370567 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.370656 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.370835 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:14.379474 (+ 8639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.380828 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.385139 (+ 4311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.386047 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.386178 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.410769 (+ 24591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:14.410781 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:14.410788 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:14.410842 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:14.415186 (+ 4344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.418247 (+ 3061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.418255 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.418259 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.418453 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.418916 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.418922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.418925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.419267 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:14.419403 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.419976 (+ 573us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.420212 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30214,"thread_start_us":30110,"threads_started":1}
I20260923 19:36:14.420919 20340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.373658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49334 (local address 127.12.159.254:36803)
0923 19:36:14.393595 (+ 19937us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.393602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.393620 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:36:14.393671 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.393677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.393755 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.393916 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:14.396442 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.397704 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.405535 (+ 7831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.406224 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.406327 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.413309 (+ 6982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:14.413315 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:14.413322 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:14.413366 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:14.417391 (+ 4025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.418499 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.418508 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.418512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.418664 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.419133 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.419138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.419141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.419508 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:14.419708 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.420318 (+ 610us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.420531 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19681,"thread_start_us":24160,"threads_started":1}
I20260923 19:36:14.421756 20336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.340897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.12.159.195:33893)
0923 19:36:14.367273 (+ 26376us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.367303 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.369402 (+ 2099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.371268 (+ 1866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.371286 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.372610 (+ 1324us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:14.378778 (+ 6168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.378799 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.381092 (+ 2293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.381100 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.382905 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.382921 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.386575 (+ 3654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.386584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.386834 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.387861 (+ 1027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:14.387894 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:14.406798 (+ 18904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:14.415426 (+ 8628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:14.415447 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:14.415455 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:14.416198 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:14.418616 (+ 2418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:14.418622 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:14.418625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:14.418788 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:14.419499 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:14.419503 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:14.419677 (+ 174us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.420811 (+ 1134us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.421324 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26125,"mutex_wait_us":162,"spinlock_wait_cycles":14208,"thread_start_us":12713,"threads_started":1}
I20260923 19:36:14.421986 20343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.377971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44532 (local address 127.12.159.253:33685)
0923 19:36:14.382429 (+ 4458us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.382435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.388709 (+ 6274us) server_negotiation.cc:407] Connection header received
0923 19:36:14.388760 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.388766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.388843 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.388964 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:14.391562 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.392777 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.404492 (+ 11715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.405159 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.405281 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.413384 (+ 8103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:14.413392 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:14.413396 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:14.413436 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:14.417571 (+ 4135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.418585 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.418590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.418593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.418773 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.419652 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.419659 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.419663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.420050 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:14.420290 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.421300 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.421546 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4333,"thread_start_us":5051,"threads_started":1}
I20260923 19:36:14.422653 20326 heartbeater.cc:347] Connected to a master server at 127.12.159.252:41375
I20260923 19:36:14.422801 20326 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:14.423250 20326 heartbeater.cc:511] Master 127.12.159.252:41375 requested a full tablet report, sending...
I20260923 19:36:14.424762 19863 ts_manager.cc:194] Registered new tserver with Master: dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811)
I20260923 19:36:14.426874 19062 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:36:14.436177 20344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.383218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55298 (local address 127.12.159.252:41375)
0923 19:36:14.418269 (+ 35051us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.418277 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.418298 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:36:14.418356 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.418362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.418464 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.418570 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:14.422134 (+ 3564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.424228 (+ 2094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.426171 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.426765 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.426906 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.429405 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:14.429411 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:14.429416 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:14.429454 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:14.432985 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.434023 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.434030 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.434033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.434198 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:14.434591 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:14.434595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:14.434598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:14.434982 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:14.435196 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.435565 (+ 369us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.435792 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34884,"thread_start_us":34738,"threads_started":1}
W20260923 19:36:14.436386 19062 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:14.468724 20357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.454771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51228 (local address 127.12.159.195:33811)
0923 19:36:14.455760 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.455773 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.456753 (+ 980us) server_negotiation.cc:407] Connection header received
0923 19:36:14.457052 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.457064 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.457392 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.457632 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:14.458529 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.461551 (+ 3022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.465485 (+ 3934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.467154 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.467313 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.467498 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.468242 (+ 744us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.468399 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":957,"threads_started":1}
I20260923 19:36:14.468756 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.454357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33811 (local address 127.0.0.1:51228)
0923 19:36:14.456595 (+ 2238us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.456624 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.456820 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.457633 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.457641 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.457678 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:14.458247 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.458264 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.461888 (+ 3624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.461897 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.465260 (+ 3363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.465285 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.467654 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.467664 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.467983 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.468044 (+ 61us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.468189 (+ 145us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.468339 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":93,"thread_start_us":350,"threads_started":1}
I20260923 19:36:14.473013 20261 tablet_service.cc:1467] Processing CreateTablet for tablet 2dcb64fcd48645e490717cd04456d8f3 (DEFAULT_TABLE table=test-table [id=10693b1aa95041e4a093d7b59c9ea6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:14.474462 20261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dcb64fcd48645e490717cd04456d8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:14.475570 20359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.455255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43583 (local address 127.0.0.1:47732)
0923 19:36:14.466422 (+ 11167us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.466445 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.466588 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.467649 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.467653 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.467670 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:14.468241 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.468258 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.470721 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.470728 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.472519 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.472533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.474568 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.474575 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.474761 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.474800 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.474909 (+ 109us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.475055 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11055,"mutex_wait_us":164,"spinlock_wait_cycles":12928,"thread_start_us":10767,"threads_started":1}
I20260923 19:36:14.476116 20358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.455255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:34749 (local address 127.0.0.1:43358)
0923 19:36:14.466415 (+ 11160us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.466438 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.466588 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.467621 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.467632 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.467660 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:14.468319 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.468331 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.471225 (+ 2894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.471234 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.473377 (+ 2143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.473391 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.475235 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.475241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.475422 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.475453 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.475576 (+ 123us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.475703 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10973,"mutex_wait_us":39,"spinlock_wait_cycles":2176,"thread_start_us":10759,"threads_started":1}
I20260923 19:36:14.476178 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.455563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43358 (local address 127.12.159.194:34749)
0923 19:36:14.465613 (+ 10050us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.465620 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.466732 (+ 1112us) server_negotiation.cc:407] Connection header received
0923 19:36:14.466850 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.466859 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.467144 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.467377 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:14.468529 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.471056 (+ 2527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.473550 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.475006 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.475185 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.475351 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.475637 (+ 286us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.475817 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9893,"thread_start_us":10049,"threads_started":1}
I20260923 19:36:14.477835 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.455864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47732 (local address 127.12.159.193:43583)
0923 19:36:14.456455 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.456466 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.466736 (+ 10270us) server_negotiation.cc:407] Connection header received
0923 19:36:14.466868 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.466875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.467144 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.467435 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:14.468526 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.470569 (+ 2043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.472723 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.474051 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.474233 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.474423 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.477258 (+ 2835us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.477463 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"spinlock_wait_cycles":1408,"thread_start_us":362,"threads_started":1}
I20260923 19:36:14.479959 20120 tablet_service.cc:1467] Processing CreateTablet for tablet 2dcb64fcd48645e490717cd04456d8f3 (DEFAULT_TABLE table=test-table [id=10693b1aa95041e4a093d7b59c9ea6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:14.481323 20120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dcb64fcd48645e490717cd04456d8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:14.481227 19980 tablet_service.cc:1467] Processing CreateTablet for tablet 2dcb64fcd48645e490717cd04456d8f3 (DEFAULT_TABLE table=test-table [id=10693b1aa95041e4a093d7b59c9ea6f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:14.482362 19980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dcb64fcd48645e490717cd04456d8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:14.493265 20362 tablet_bootstrap.cc:492] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Bootstrap starting.
I20260923 19:36:14.497291 20362 tablet_bootstrap.cc:654] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:14.498569 20362 log.cc:824] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:14.498610 20363 tablet_bootstrap.cc:492] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Bootstrap starting.
I20260923 19:36:14.500662 20364 tablet_bootstrap.cc:492] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Bootstrap starting.
I20260923 19:36:14.503485 20363 tablet_bootstrap.cc:654] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:14.503680 20364 tablet_bootstrap.cc:654] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:14.504649 20363 log.cc:824] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:14.504980 20364 log.cc:824] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:14.507468 20362 tablet_bootstrap.cc:492] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: No bootstrap required, opened a new log
I20260923 19:36:14.507809 20362 ts_tablet_manager.cc:1397] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.006s
I20260923 19:36:14.508992 20363 tablet_bootstrap.cc:492] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: No bootstrap required, opened a new log
I20260923 19:36:14.509268 20363 ts_tablet_manager.cc:1397] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260923 19:36:14.509999 20364 tablet_bootstrap.cc:492] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: No bootstrap required, opened a new log
I20260923 19:36:14.510281 20364 ts_tablet_manager.cc:1397] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260923 19:36:14.516983 20363 raft_consensus.cc:348] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.517374 20363 raft_consensus.cc:374] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:14.517480 20363 raft_consensus.cc:729] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbb307c3048e491abf2eaf969fbdc021, State: Initialized, Role: FOLLOWER
I20260923 19:36:14.518205 20363 consensus_queue.cc:260] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.519342 20362 raft_consensus.cc:348] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.519836 20362 raft_consensus.cc:374] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:14.519963 20362 raft_consensus.cc:729] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ec1339286574c59a237f1790aae02e3, State: Initialized, Role: FOLLOWER
I20260923 19:36:14.520695 20362 consensus_queue.cc:260] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.521452 20364 raft_consensus.cc:348] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.522042 20364 raft_consensus.cc:374] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:14.522162 20364 raft_consensus.cc:729] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd59290fd3b46e2bcd3bbb61c123a58, State: Initialized, Role: FOLLOWER
I20260923 19:36:14.523103 20364 consensus_queue.cc:260] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.528105 20363 ts_tablet_manager.cc:1428] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Time spent starting tablet: real 0.019s user 0.011s sys 0.007s
I20260923 19:36:14.528661 20364 ts_tablet_manager.cc:1428] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260923 19:36:14.531020 20186 heartbeater.cc:503] Master 127.12.159.254:36803 was elected leader, sending a full tablet report...
I20260923 19:36:14.533186 20327 heartbeater.cc:503] Master 127.12.159.254:36803 was elected leader, sending a full tablet report...
I20260923 19:36:14.537927 20362 ts_tablet_manager.cc:1428] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Time spent starting tablet: real 0.030s user 0.019s sys 0.010s
W20260923 19:36:14.590094 20329 tablet.cc:2369] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:36:14.598986 20048 tablet.cc:2369] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:36:14.719261 20188 tablet.cc:2369] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:36:14.830231 20368 raft_consensus.cc:482] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:14.830575 20368 raft_consensus.cc:504] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.832890 20368 leader_election.cc:288] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749), 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583)
I20260923 19:36:14.839097 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.832707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:38011 (local address 127.12.159.194:34749)
0923 19:36:14.832934 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.832940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.832962 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:36:14.833140 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.833146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.833230 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.833365 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:14.833774 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.834809 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.836919 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.838062 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.838209 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.838295 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.838700 (+ 405us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.838844 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:36:14.839108 20336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.832527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:34749 (local address 127.12.159.195:38011)
0923 19:36:14.832754 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.832776 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.832942 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.833388 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.833393 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.833424 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:14.833619 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.833631 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.834950 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.834954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.836767 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.836781 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.838245 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.838249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.838489 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.838515 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.838662 (+ 147us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.838815 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":24}
I20260923 19:36:14.839720 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.833315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43583 (local address 127.12.159.195:50435)
0923 19:36:14.833621 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:14.833639 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:14.833763 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:14.834121 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:14.834125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:14.834149 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:14.834309 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.834316 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.835596 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.835602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.837389 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:14.837399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.839068 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.839074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:14.839296 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.839327 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:36:14.839422 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 19:36:14.839535 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":68}
I20260923 19:36:14.840278 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.833339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:50435 (local address 127.12.159.193:43583)
0923 19:36:14.833533 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.833540 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.833728 (+ 188us) server_negotiation.cc:407] Connection header received
0923 19:36:14.833940 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.833944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.834000 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.834099 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:14.834497 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.835441 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.837546 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.838912 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.839077 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.839145 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.839947 (+ 802us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.840061 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:36:14.840215 20140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dcb64fcd48645e490717cd04456d8f3" candidate_uuid: "dbb307c3048e491abf2eaf969fbdc021" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" is_pre_election: true
I20260923 19:36:14.840740 20140 raft_consensus.cc:2454] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbb307c3048e491abf2eaf969fbdc021 in term 0.
I20260923 19:36:14.841238 20000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dcb64fcd48645e490717cd04456d8f3" candidate_uuid: "dbb307c3048e491abf2eaf969fbdc021" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ec1339286574c59a237f1790aae02e3" is_pre_election: true
I20260923 19:36:14.841661 20214 leader_election.cc:302] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd59290fd3b46e2bcd3bbb61c123a58, dbb307c3048e491abf2eaf969fbdc021; no voters:
I20260923 19:36:14.841792 20000 raft_consensus.cc:2454] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbb307c3048e491abf2eaf969fbdc021 in term 0.
I20260923 19:36:14.842149 20368 raft_consensus.cc:2781] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:14.842370 20368 raft_consensus.cc:482] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:14.842489 20368 raft_consensus.cc:3037] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:14.844914 20368 raft_consensus.cc:504] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.845513 20368 leader_election.cc:288] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [CANDIDATE]: Term 1 election: Requested vote from peers 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749), 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583)
I20260923 19:36:14.846050 20000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dcb64fcd48645e490717cd04456d8f3" candidate_uuid: "dbb307c3048e491abf2eaf969fbdc021" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ec1339286574c59a237f1790aae02e3"
I20260923 19:36:14.846051 20140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dcb64fcd48645e490717cd04456d8f3" candidate_uuid: "dbb307c3048e491abf2eaf969fbdc021" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58"
I20260923 19:36:14.846268 20140 raft_consensus.cc:3037] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:14.846268 20000 raft_consensus.cc:3037] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:14.849552 20140 raft_consensus.cc:2454] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbb307c3048e491abf2eaf969fbdc021 in term 1.
I20260923 19:36:14.849545 20000 raft_consensus.cc:2454] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbb307c3048e491abf2eaf969fbdc021 in term 1.
I20260923 19:36:14.850013 20215 leader_election.cc:302] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ec1339286574c59a237f1790aae02e3, dbb307c3048e491abf2eaf969fbdc021; no voters:
I20260923 19:36:14.850348 20368 raft_consensus.cc:2781] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:14.850737 20368 raft_consensus.cc:686] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 1 LEADER]: Becoming Leader. State: Replica: dbb307c3048e491abf2eaf969fbdc021, State: Running, Role: LEADER
I20260923 19:36:14.851497 20368 consensus_queue.cc:237] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } }
I20260923 19:36:14.856911 19061 catalog_manager.cc:5495] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195). New cstate: current_term: 1 leader_uuid: "dbb307c3048e491abf2eaf969fbdc021" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } health_report { overall_health: UNKNOWN } } }
I20260923 19:36:14.928241 20357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.922669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.12.159.195:33811)
0923 19:36:14.922933 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.922940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.923052 (+ 112us) server_negotiation.cc:407] Connection header received
0923 19:36:14.923320 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.923324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.923416 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.923581 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:14.924005 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.924707 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.926077 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:14.926483 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:14.926622 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:14.927117 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:14.927652 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:14.927829 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:14.927880 (+ 51us) server_negotiation.cc:299] Negotiation successful
0923 19:36:14.927961 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260923 19:36:14.937076 20000 raft_consensus.cc:1261] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Refusing update from remote peer dbb307c3048e491abf2eaf969fbdc021: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:14.937073 20140 raft_consensus.cc:1261] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 FOLLOWER]: Refusing update from remote peer dbb307c3048e491abf2eaf969fbdc021: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:14.938186 20371 consensus_queue.cc:1035] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:14.938550 20368 consensus_queue.cc:1035] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:14.959056 20377 mvcc.cc:205] Tried to move back new op lower bound from 7332627148530446336 to 7332627148195254272. Current Snapshot: MvccSnapshot[applied={T|T < 7332627148530446336}]
I20260923 19:36:14.962150 20375 mvcc.cc:205] Tried to move back new op lower bound from 7332627148530446336 to 7332627148195254272. Current Snapshot: MvccSnapshot[applied={T|T < 7332627148530446336 or (T in {7332627148530446336})}]
I20260923 19:36:14.975215 19061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:14.975526 19061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:14.983340 19061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ae18a6683f4428ea5a5393ff709e6b1: Sending DeleteTablet for 3 replicas of tablet 2dcb64fcd48645e490717cd04456d8f3
I20260923 19:36:14.984743 19980 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dcb64fcd48645e490717cd04456d8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:14 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:47732
I20260923 19:36:14.984928 20120 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dcb64fcd48645e490717cd04456d8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:14 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:43358
I20260923 19:36:14.985459 20261 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dcb64fcd48645e490717cd04456d8f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:14 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51228
I20260923 19:36:14.987349 20387 tablet_replica.cc:330] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: stopping tablet replica
I20260923 19:36:14.987620 20388 tablet_replica.cc:330] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: stopping tablet replica
I20260923 19:36:14.987828 20386 tablet_replica.cc:330] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: stopping tablet replica
I20260923 19:36:14.988039 20388 raft_consensus.cc:2229] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:36:14.988334 20386 raft_consensus.cc:2229] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:14.988663 20388 raft_consensus.cc:2258] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:14.988885 20386 raft_consensus.cc:2258] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:14.991147 20386 ts_tablet_manager.cc:1905] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:14.991147 20388 ts_tablet_manager.cc:1905] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:14.994174 20387 raft_consensus.cc:2229] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:14.998299 20386 ts_tablet_manager.cc:1918] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:14.998540 20386 log.cc:1196] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/2dcb64fcd48645e490717cd04456d8f3
I20260923 19:36:14.999035 20387 raft_consensus.cc:2258] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:14.999300 20386 ts_tablet_manager.cc:1939] T 2dcb64fcd48645e490717cd04456d8f3 P 6ec1339286574c59a237f1790aae02e3: Deleting consensus metadata
I20260923 19:36:15.002050 20387 ts_tablet_manager.cc:1905] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:15.006544 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 19030
I20260923 19:36:15.006960 20388 ts_tablet_manager.cc:1918] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:15.007145 20388 log.cc:1196] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/2dcb64fcd48645e490717cd04456d8f3
I20260923 19:36:15.008194 19047 catalog_manager.cc:4841] TS 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583): tablet 2dcb64fcd48645e490717cd04456d8f3 (table test-table [id=10693b1aa95041e4a093d7b59c9ea6f0]) successfully deleted
I20260923 19:36:15.008688 20388 ts_tablet_manager.cc:1939] T 2dcb64fcd48645e490717cd04456d8f3 P dbb307c3048e491abf2eaf969fbdc021: Deleting consensus metadata
I20260923 19:36:15.010720 19092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:15.010974 20387 ts_tablet_manager.cc:1918] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:15.011186 20387 log.cc:1196] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/2dcb64fcd48645e490717cd04456d8f3
I20260923 19:36:15.011904 20387 ts_tablet_manager.cc:1939] T 2dcb64fcd48645e490717cd04456d8f3 P 1bd59290fd3b46e2bcd3bbb61c123a58: Deleting consensus metadata
I20260923 19:36:15.019356 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.987732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44546 (local address 127.12.159.253:33685)
0923 19:36:14.999069 (+ 11337us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:14.999078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:14.999101 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:36:14.999170 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:14.999175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:14.999257 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:14.999385 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:15.001637 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.002739 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.004628 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.005236 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.005347 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:15.009893 (+ 4546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:15.009901 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:15.009906 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:15.009947 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:15.016214 (+ 6267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.017115 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.017123 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.017130 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.017293 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.017783 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.017788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.017791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.018171 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:15.018423 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:15.018734 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 19:36:15.018961 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11208,"thread_start_us":11454,"threads_started":1}
I20260923 19:36:15.032552 20391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:14.998715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55306 (local address 127.12.159.252:41375)
0923 19:36:15.007869 (+ 9154us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:15.007876 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:15.019638 (+ 11762us) server_negotiation.cc:407] Connection header received
0923 19:36:15.019707 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:15.019712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:15.019811 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:15.019909 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:15.021915 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.022643 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.023967 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.024354 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.024492 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:15.027149 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:15.027154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:15.027157 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:15.027191 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:15.029914 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.030598 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.030605 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.030609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.030737 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.031106 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.031112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.031115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.031397 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:15.031642 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:15.031944 (+ 302us) server_negotiation.cc:299] Negotiation successful
0923 19:36:15.032189 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9021,"thread_start_us":11103,"threads_started":1}
I20260923 19:36:15.161096 19046 catalog_manager.cc:4841] TS 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749): tablet 2dcb64fcd48645e490717cd04456d8f3 (table test-table [id=10693b1aa95041e4a093d7b59c9ea6f0]) successfully deleted
W20260923 19:36:15.161330 19046 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.159.194:34749, user_credentials={real_user=slave}} blocked reactor thread for 147474us
I20260923 19:36:15.161793 19048 catalog_manager.cc:4841] TS dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811): tablet 2dcb64fcd48645e490717cd04456d8f3 (table test-table [id=10693b1aa95041e4a093d7b59c9ea6f0]) successfully deleted
I20260923 19:36:15.161960 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 19030
I20260923 19:36:15.210489 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:15.189279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44554 (local address 127.12.159.253:33685)
0923 19:36:15.189517 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:15.189526 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:15.191055 (+ 1529us) server_negotiation.cc:407] Connection header received
0923 19:36:15.191407 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:15.191416 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:15.191545 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:15.191649 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:15.194789 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.196327 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.199084 (+ 2757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.200027 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.200160 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:15.204157 (+ 3997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:15.204163 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:15.204166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:15.204201 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:15.207465 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.208340 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.208347 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.208350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.208500 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.208940 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.208947 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.208952 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.209266 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:15.209535 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:15.209965 (+ 430us) server_negotiation.cc:299] Negotiation successful
0923 19:36:15.210171 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:36:15.216939 20391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:15.190579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55310 (local address 127.12.159.252:41375)
0923 19:36:15.190813 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:15.190821 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:15.201409 (+ 10588us) server_negotiation.cc:407] Connection header received
0923 19:36:15.201990 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:15.201999 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:15.202116 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:15.202227 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:15.204433 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.205513 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.207391 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:15.207940 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:15.208098 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:15.211714 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:15.211721 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:15.211725 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:15.211762 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:15.214375 (+ 2613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.215187 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.215191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.215193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.215307 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:15.215673 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:15.215676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:15.215678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:15.215946 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:15.216138 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:15.216517 (+ 379us) server_negotiation.cc:299] Negotiation successful
0923 19:36:15.216680 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:36:15.968739 20400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:15.967823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:34005)
0923 19:36:15.968402 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:15.968531 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":325,"threads_started":1}
W20260923 19:36:15.969238 20327 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:36803 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:15.972270 20401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:15.971469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:40265)
0923 19:36:15.971951 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:15.972082 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":225,"threads_started":1}
W20260923 19:36:15.972734 20046 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:36803 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:15.988551 20402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:15.987237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:58627)
0923 19:36:15.988134 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:15.988288 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":751,"thread_start_us":596,"threads_started":1}
W20260923 19:36:15.990422 20186 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:36803 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:16.482869 20403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae18a6683f4428ea5a5393ff709e6b1)
I20260923 19:36:16.483161 20403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:16.484148 20404 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae18a6683f4428ea5a5393ff709e6b1)
I20260923 19:36:16.484364 20404 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:16.484813 20403 leader_election.cc:288] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803), 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252:41375)
I20260923 19:36:16.485285 20404 leader_election.cc:288] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803), 5f284bb429c04c698b34668f80de70c7 (127.12.159.253:33685)
I20260923 19:36:16.486615 20405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.485018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49714)
0923 19:36:16.486139 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.486347 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":998,"thread_start_us":867,"threads_started":1}
I20260923 19:36:16.488737 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.485427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49722)
0923 19:36:16.488137 (+ 2710us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.488449 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2545,"threads_started":1}
W20260923 19:36:16.490384 19847 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
W20260923 19:36:16.490696 19653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:16.499782 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.485791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:33685 (local address 127.0.0.1:44556)
0923 19:36:16.489379 (+ 3588us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.489401 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:16.489561 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:16.491213 (+ 1652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:16.491221 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:16.491256 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:16.491592 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:16.491606 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.493844 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.493849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:16.496484 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:16.496503 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.498733 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.498743 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:16.498996 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:16.499055 (+ 59us) client_negotiation.cc:769] Sending connection context
0923 19:36:16.499138 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 19:36:16.499340 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3435,"thread_start_us":1999,"threads_started":1}
I20260923 19:36:16.499861 20405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.486528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:41375 (local address 127.0.0.1:55316)
0923 19:36:16.487070 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.487093 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:16.487282 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:16.491168 (+ 3886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:16.491175 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:16.491236 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:16.491513 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:16.491528 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.493818 (+ 2290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.493828 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:16.496534 (+ 2706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:16.496555 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.498832 (+ 2277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.498841 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:16.499102 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:16.499170 (+ 68us) client_negotiation.cc:769] Sending connection context
0923 19:36:16.499251 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 19:36:16.499456 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":1006,"threads_started":1}
I20260923 19:36:16.500983 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.487781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44556 (local address 127.12.159.253:33685)
0923 19:36:16.490809 (+ 3028us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:16.490817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:16.490841 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:36:16.490927 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:16.490934 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:16.491030 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:16.491766 (+ 736us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:16.492106 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.493613 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.496752 (+ 3139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.498493 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.500306 (+ 1813us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:16.500418 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:16.500476 (+ 58us) server_negotiation.cc:299] Negotiation successful
0923 19:36:16.500613 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2840,"thread_start_us":2654,"threads_started":1}
I20260923 19:36:16.501498 20410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.488113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55316 (local address 127.12.159.252:41375)
0923 19:36:16.490571 (+ 2458us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:16.490577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:16.490651 (+ 74us) server_negotiation.cc:407] Connection header received
0923 19:36:16.490723 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:16.490728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:16.490881 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:16.491677 (+ 796us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:16.491963 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.493593 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.496811 (+ 3218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:16.498585 (+ 1774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:16.500483 (+ 1898us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:16.500603 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:16.500663 (+ 60us) server_negotiation.cc:299] Negotiation successful
0923 19:36:16.500886 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2313,"thread_start_us":2119,"threads_started":1}
I20260923 19:36:16.501896 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.501487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49734)
0923 19:36:16.501633 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.501730 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260923 19:36:16.501899 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8854a52e27364d7094151c6aec4ce0eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5f284bb429c04c698b34668f80de70c7" is_pre_election: true
W20260923 19:36:16.502168 19847 leader_election.cc:334] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803): Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:16.502240 19679 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8854a52e27364d7094151c6aec4ce0eb in term 1.
I20260923 19:36:16.502993 20405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.502586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49750)
0923 19:36:16.502742 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.502838 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260923 19:36:16.502895 19849 leader_election.cc:302] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f284bb429c04c698b34668f80de70c7, 8854a52e27364d7094151c6aec4ce0eb; no voters: 9ae18a6683f4428ea5a5393ff709e6b1
I20260923 19:36:16.502890 19873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5f284bb429c04c698b34668f80de70c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8854a52e27364d7094151c6aec4ce0eb" is_pre_election: true
W20260923 19:36:16.503180 19653 leader_election.cc:334] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803): Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:16.503258 19873 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f284bb429c04c698b34668f80de70c7 in term 1.
I20260923 19:36:16.503415 20404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260923 19:36:16.503561 20404 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae18a6683f4428ea5a5393ff709e6b1)
I20260923 19:36:16.503657 20404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:36:16.503800 19653 leader_election.cc:302] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f284bb429c04c698b34668f80de70c7, 8854a52e27364d7094151c6aec4ce0eb; no voters: 9ae18a6683f4428ea5a5393ff709e6b1
I20260923 19:36:16.504338 20403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260923 19:36:16.504452 20403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae18a6683f4428ea5a5393ff709e6b1)
I20260923 19:36:16.504547 20403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:36:16.506392 20404 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:16.507145 20404 leader_election.cc:288] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 2 election: Requested vote from peers 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803), 5f284bb429c04c698b34668f80de70c7 (127.12.159.253:33685)
I20260923 19:36:16.507119 20403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:16.507474 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.507045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49770)
0923 19:36:16.507207 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.507284 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260923 19:36:16.507643 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8854a52e27364d7094151c6aec4ce0eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5f284bb429c04c698b34668f80de70c7"
I20260923 19:36:16.508283 19679 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8854a52e27364d7094151c6aec4ce0eb in current term 2: Already voted for candidate 5f284bb429c04c698b34668f80de70c7 in this term.
I20260923 19:36:16.508463 20403 leader_election.cc:288] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803), 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252:41375)
I20260923 19:36:16.508608 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.508259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49782)
0923 19:36:16.508404 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.508471 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260923 19:36:16.508854 19847 leader_election.cc:334] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803): Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:16.509130 20405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.508822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49794)
0923 19:36:16.508947 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.509025 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260923 19:36:16.509298 19873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5f284bb429c04c698b34668f80de70c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8854a52e27364d7094151c6aec4ce0eb"
I20260923 19:36:16.509413 19849 leader_election.cc:302] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8854a52e27364d7094151c6aec4ce0eb; no voters: 5f284bb429c04c698b34668f80de70c7, 9ae18a6683f4428ea5a5393ff709e6b1
I20260923 19:36:16.509615 19873 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f284bb429c04c698b34668f80de70c7 in current term 2: Already voted for candidate 8854a52e27364d7094151c6aec4ce0eb in this term.
I20260923 19:36:16.509788 20404 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260923 19:36:16.510886 20405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.510390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:49798)
0923 19:36:16.510639 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.510711 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260923 19:36:16.511111 19653 leader_election.cc:334] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803): Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:16.511236 19653 leader_election.cc:302] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f284bb429c04c698b34668f80de70c7; no voters: 8854a52e27364d7094151c6aec4ce0eb, 9ae18a6683f4428ea5a5393ff709e6b1
I20260923 19:36:16.511551 20403 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260923 19:36:16.970937 20413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.970117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:38903)
0923 19:36:16.970622 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.970738 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":249,"threads_started":1}
I20260923 19:36:16.974066 20414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.973361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:60243)
0923 19:36:16.973799 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.973913 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":244,"threads_started":1}
I20260923 19:36:16.992395 20415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:16.991534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:58121)
0923 19:36:16.992105 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:16.992206 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":336,"threads_started":1}
I20260923 19:36:17.973119 20416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:17.972184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:35877)
0923 19:36:17.972754 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:17.972866 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":333,"threads_started":1}
I20260923 19:36:17.975862 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:17.975015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:42773)
0923 19:36:17.975571 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:17.975691 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":294,"threads_started":1}
I20260923 19:36:17.994437 20418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:17.993541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:55815)
0923 19:36:17.994167 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:17.994260 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":288,"threads_started":1}
I20260923 19:36:18.131723 20419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:18.132089 20419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:18.132840 20419 leader_election.cc:288] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803), 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252:41375)
I20260923 19:36:18.133857 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.133024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:50024)
0923 19:36:18.133499 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.133608 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":222,"threads_started":1}
I20260923 19:36:18.134053 19873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5f284bb429c04c698b34668f80de70c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8854a52e27364d7094151c6aec4ce0eb" is_pre_election: true
I20260923 19:36:18.134306 19873 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f284bb429c04c698b34668f80de70c7 in term 2.
I20260923 19:36:18.135084 19653 leader_election.cc:302] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f284bb429c04c698b34668f80de70c7, 8854a52e27364d7094151c6aec4ce0eb; no voters:
I20260923 19:36:18.135215 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.134902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:50040)
0923 19:36:18.135028 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.135100 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:36:18.135471 19653 leader_election.cc:334] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803): Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:18.135492 20419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260923 19:36:18.135766 20419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:18.135931 20419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:36:18.138535 20419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:18.139122 20419 leader_election.cc:288] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803), 8854a52e27364d7094151c6aec4ce0eb (127.12.159.252:41375)
I20260923 19:36:18.139706 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.139294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:50048)
0923 19:36:18.139471 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.139557 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260923 19:36:18.139955 19873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5f284bb429c04c698b34668f80de70c7" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8854a52e27364d7094151c6aec4ce0eb"
I20260923 19:36:18.140172 19873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:36:18.141105 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.140681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:50062)
0923 19:36:18.140839 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.140984 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260923 19:36:18.141299 19653 leader_election.cc:334] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803): Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
I20260923 19:36:18.142550 19873 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f284bb429c04c698b34668f80de70c7 in term 3.
I20260923 19:36:18.143077 19653 leader_election.cc:302] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f284bb429c04c698b34668f80de70c7, 8854a52e27364d7094151c6aec4ce0eb; no voters: 9ae18a6683f4428ea5a5393ff709e6b1
I20260923 19:36:18.143414 20419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 19:36:18.143819 20419 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [term 3 LEADER]: Becoming Leader. State: Replica: 5f284bb429c04c698b34668f80de70c7, State: Running, Role: LEADER
I20260923 19:36:18.144229 20419 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } }
I20260923 19:36:18.145908 20422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f284bb429c04c698b34668f80de70c7. Latest consensus state: current_term: 3 leader_uuid: "5f284bb429c04c698b34668f80de70c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:18.146360 20422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:18.147174 20424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:18.150990 20424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:18.151839 20424 catalog_manager.cc:1259] Loaded cluster ID: a8f6e8f7ceda4222bca1e99e22e5b3a4
I20260923 19:36:18.151914 20424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:18.153155 20424 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:18.154095 20424 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Loaded TSK: 0
I20260923 19:36:18.154947 20424 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:36:18.196795 19667 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:36:18.203810 19667 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:18.208562 19873 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [term 3 FOLLOWER]: Refusing update from remote peer 5f284bb429c04c698b34668f80de70c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260923 19:36:18.208616 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.208191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:50080)
0923 19:36:18.208377 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.208459 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 19:36:18.209295 20422 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260923 19:36:18.210014 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.209397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:50096)
0923 19:36:18.209692 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.209782 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260923 19:36:18.210207 19653 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 -> Peer 9ae18a6683f4428ea5a5393ff709e6b1 (127.12.159.254:36803): Couldn't send request to peer 9ae18a6683f4428ea5a5393ff709e6b1. Status: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:36:18.212468 20426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f284bb429c04c698b34668f80de70c7. Latest consensus state: current_term: 3 leader_uuid: "5f284bb429c04c698b34668f80de70c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:18.212744 20426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:18.214296 20419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5f284bb429c04c698b34668f80de70c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:18.214732 20419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:18.215519 20426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5f284bb429c04c698b34668f80de70c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9ae18a6683f4428ea5a5393ff709e6b1" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36803 } } peers { permanent_uuid: "5f284bb429c04c698b34668f80de70c7" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 33685 } attrs { promote: false } } peers { permanent_uuid: "8854a52e27364d7094151c6aec4ce0eb" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 41375 } attrs { promote: false } } }
I20260923 19:36:18.215821 20426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8854a52e27364d7094151c6aec4ce0eb [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:36:18.240579 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.225450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43362 (local address 127.12.159.194:34749)
0923 19:36:18.230274 (+ 4824us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.230283 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.230316 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:36:18.230411 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.230419 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.230548 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.231535 (+ 987us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:18.231790 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.233261 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.236575 (+ 3314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.238339 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.239735 (+ 1396us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.239851 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.239918 (+ 67us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.240112 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4657,"thread_start_us":4544,"threads_started":1}
I20260923 19:36:18.241099 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.225142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:34749 (local address 127.0.0.1:43362)
0923 19:36:18.225713 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.225733 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:18.225873 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:18.230753 (+ 4880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:18.230762 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:18.230801 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:18.231315 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.231332 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.233482 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.233488 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.236256 (+ 2768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.236277 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.238588 (+ 2311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.238600 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.238793 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.238835 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 19:36:18.238923 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 19:36:18.239058 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":3845,"threads_started":1}
I20260923 19:36:18.242137 20120 tablet_service.cc:1467] Processing CreateTablet for tablet fdecbb79b6ec490d9eb3a1c2623ce53f (DEFAULT_TABLE table=test-table [id=5c4f7e18a2c146dfa425f4f41769b9cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:18.242625 20120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdecbb79b6ec490d9eb3a1c2623ce53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:18.244586 20433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.224211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33811 (local address 127.0.0.1:51240)
0923 19:36:18.224824 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.224840 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:18.224952 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:18.234508 (+ 9556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:18.234518 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:18.234560 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:18.235164 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.235182 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.237433 (+ 2251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.237444 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.241906 (+ 4462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.241921 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.243575 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.243583 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.243842 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.243899 (+ 57us) client_negotiation.cc:769] Sending connection context
0923 19:36:18.243986 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 19:36:18.244125 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":8,"thread_start_us":549,"threads_started":1}
I20260923 19:36:18.244913 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.224630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51240 (local address 127.12.159.195:33811)
0923 19:36:18.233838 (+ 9208us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.233989 (+ 151us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.234025 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:36:18.234134 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.234144 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.234262 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.235400 (+ 1138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:18.235689 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.237215 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.242113 (+ 4898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.243297 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.244316 (+ 1019us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.244397 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.244449 (+ 52us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.244590 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8994,"thread_start_us":8815,"threads_started":1}
I20260923 19:36:18.245736 20261 tablet_service.cc:1467] Processing CreateTablet for tablet fdecbb79b6ec490d9eb3a1c2623ce53f (DEFAULT_TABLE table=test-table [id=5c4f7e18a2c146dfa425f4f41769b9cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:18.246250 20261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdecbb79b6ec490d9eb3a1c2623ce53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:18.247756 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.223827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43583 (local address 127.0.0.1:47744)
0923 19:36:18.224001 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.224022 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:18.224143 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:18.239234 (+ 15091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:18.239240 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:18.239272 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:18.241751 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.241776 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.243118 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.243125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.245390 (+ 2265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.245407 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.247041 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.247048 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.247228 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.247263 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 19:36:18.247330 (+ 67us) client_negotiation.cc:240] Negotiation successful
0923 19:36:18.247458 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":44}
I20260923 19:36:18.248616 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.223884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47744 (local address 127.12.159.193:43583)
0923 19:36:18.238856 (+ 14972us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.238862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.238882 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:36:18.238992 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.238998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.239082 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.239189 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:18.241948 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.242949 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.245571 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.246788 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.248014 (+ 1226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.248089 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.248137 (+ 48us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.248289 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14830,"thread_start_us":14720,"threads_started":1}
I20260923 19:36:18.249444 19980 tablet_service.cc:1467] Processing CreateTablet for tablet fdecbb79b6ec490d9eb3a1c2623ce53f (DEFAULT_TABLE table=test-table [id=5c4f7e18a2c146dfa425f4f41769b9cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:18.249568 20437 tablet_bootstrap.cc:492] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: Bootstrap starting.
I20260923 19:36:18.249948 19980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdecbb79b6ec490d9eb3a1c2623ce53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:18.251439 20437 tablet_bootstrap.cc:654] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:18.253643 20437 tablet_bootstrap.cc:492] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: No bootstrap required, opened a new log
I20260923 19:36:18.253775 20437 ts_tablet_manager.cc:1397] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:36:18.254603 20437 raft_consensus.cc:348] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.254876 20437 raft_consensus.cc:374] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:18.254966 20437 raft_consensus.cc:729] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd59290fd3b46e2bcd3bbb61c123a58, State: Initialized, Role: FOLLOWER
I20260923 19:36:18.255190 20437 consensus_queue.cc:260] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.256582 20440 tablet_bootstrap.cc:492] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: Bootstrap starting.
I20260923 19:36:18.257176 20441 tablet_bootstrap.cc:492] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: Bootstrap starting.
I20260923 19:36:18.258648 20440 tablet_bootstrap.cc:654] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:18.259569 20441 tablet_bootstrap.cc:654] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:18.260983 20440 tablet_bootstrap.cc:492] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: No bootstrap required, opened a new log
I20260923 19:36:18.261221 20440 ts_tablet_manager.cc:1397] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260923 19:36:18.262053 20418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.261490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:36651)
0923 19:36:18.261747 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.261885 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260923 19:36:18.262383 20437 ts_tablet_manager.cc:1428] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260923 19:36:18.262789 20440 raft_consensus.cc:348] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.263141 20440 raft_consensus.cc:374] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:18.263293 20440 raft_consensus.cc:729] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbb307c3048e491abf2eaf969fbdc021, State: Initialized, Role: FOLLOWER
I20260923 19:36:18.263530 20418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.263078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:47777)
0923 19:36:18.263285 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.263362 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260923 19:36:18.263742 20441 tablet_bootstrap.cc:492] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: No bootstrap required, opened a new log
I20260923 19:36:18.263885 20441 ts_tablet_manager.cc:1397] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260923 19:36:18.263701 20440 consensus_queue.cc:260] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.264616 20187 heartbeater.cc:503] Master 127.12.159.253:33685 was elected leader, sending a full tablet report...
I20260923 19:36:18.264819 20441 raft_consensus.cc:348] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.265157 20441 raft_consensus.cc:374] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:18.265259 20441 raft_consensus.cc:729] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ec1339286574c59a237f1790aae02e3, State: Initialized, Role: FOLLOWER
I20260923 19:36:18.265517 20441 consensus_queue.cc:260] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.270552 20441 ts_tablet_manager.cc:1428] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260923 19:36:18.274987 20440 ts_tablet_manager.cc:1428] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: Time spent starting tablet: real 0.014s user 0.006s sys 0.002s
I20260923 19:36:18.275803 20416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.275267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:56901)
0923 19:36:18.275516 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.275628 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
I20260923 19:36:18.276539 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.275809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:42083)
0923 19:36:18.276207 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.276314 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290}
I20260923 19:36:18.278260 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.277627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:32925)
0923 19:36:18.277996 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.278086 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263}
I20260923 19:36:18.278247 20328 heartbeater.cc:503] Master 127.12.159.253:33685 was elected leader, sending a full tablet report...
I20260923 19:36:18.279030 20416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.277793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:37175)
0923 19:36:18.278136 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.278234 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240}
I20260923 19:36:18.282051 20047 heartbeater.cc:503] Master 127.12.159.253:33685 was elected leader, sending a full tablet report...
I20260923 19:36:18.372756 20439 raft_consensus.cc:482] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:18.373044 20439 raft_consensus.cc:504] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.375322 20439 leader_election.cc:288] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583), dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811)
I20260923 19:36:18.383553 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.375725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:58921 (local address 127.12.159.195:33811)
0923 19:36:18.375939 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.375947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.375975 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:36:18.376227 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.376231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.376293 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.376412 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:18.377229 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.378191 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.380560 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.382147 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.382344 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.382464 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.383135 (+ 671us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.383275 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:36:18.383867 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.375814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:45635 (local address 127.12.159.193:43583)
0923 19:36:18.376041 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.376049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.376933 (+ 884us) server_negotiation.cc:407] Connection header received
0923 19:36:18.377130 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.377139 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.377229 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.377350 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:18.377890 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.379184 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.381300 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.382528 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.382694 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.382765 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.383369 (+ 604us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.383492 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260923 19:36:18.384087 20418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.375596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33811 (local address 127.12.159.194:58921)
0923 19:36:18.375857 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.375878 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:18.376013 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:18.376632 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:18.376637 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:18.376678 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:18.377074 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.377089 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.378320 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.378328 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.380371 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.380386 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.382617 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.382626 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.382886 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.382977 (+ 91us) client_negotiation.cc:769] Sending connection context
0923 19:36:18.383100 (+ 123us) client_negotiation.cc:240] Negotiation successful
0923 19:36:18.383310 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":4}
I20260923 19:36:18.384673 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.375596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:43583 (local address 127.12.159.194:45635)
0923 19:36:18.376818 (+ 1222us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.376835 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:18.376961 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:18.377371 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:18.377375 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:18.377400 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:18.377702 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.377714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.379311 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.379316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.381126 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:18.381140 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.382920 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.382924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:18.383180 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.383214 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:36:18.384177 (+ 963us) client_negotiation.cc:240] Negotiation successful
0923 19:36:18.384332 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1085,"mutex_wait_us":504,"thread_start_us":392,"threads_started":1}
I20260923 19:36:18.385114 20281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdecbb79b6ec490d9eb3a1c2623ce53f" candidate_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbb307c3048e491abf2eaf969fbdc021" is_pre_election: true
I20260923 19:36:18.385375 20000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdecbb79b6ec490d9eb3a1c2623ce53f" candidate_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ec1339286574c59a237f1790aae02e3" is_pre_election: true
I20260923 19:36:18.385516 20281 raft_consensus.cc:2454] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd59290fd3b46e2bcd3bbb61c123a58 in term 0.
I20260923 19:36:18.385720 20000 raft_consensus.cc:2454] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd59290fd3b46e2bcd3bbb61c123a58 in term 0.
I20260923 19:36:18.386116 20075 leader_election.cc:302] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd59290fd3b46e2bcd3bbb61c123a58, dbb307c3048e491abf2eaf969fbdc021; no voters:
I20260923 19:36:18.386528 20439 raft_consensus.cc:2781] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:18.386654 20439 raft_consensus.cc:482] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:18.386755 20439 raft_consensus.cc:3037] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:18.388875 20439 raft_consensus.cc:504] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.389472 20439 leader_election.cc:288] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583), dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811)
I20260923 19:36:18.389956 20281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdecbb79b6ec490d9eb3a1c2623ce53f" candidate_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbb307c3048e491abf2eaf969fbdc021"
I20260923 19:36:18.390015 20000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdecbb79b6ec490d9eb3a1c2623ce53f" candidate_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ec1339286574c59a237f1790aae02e3"
I20260923 19:36:18.390144 20281 raft_consensus.cc:3037] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:18.390255 20000 raft_consensus.cc:3037] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:18.392220 20281 raft_consensus.cc:2454] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd59290fd3b46e2bcd3bbb61c123a58 in term 1.
I20260923 19:36:18.392611 20075 leader_election.cc:302] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd59290fd3b46e2bcd3bbb61c123a58, dbb307c3048e491abf2eaf969fbdc021; no voters:
I20260923 19:36:18.392877 20439 raft_consensus.cc:2781] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:18.393417 20439 raft_consensus.cc:686] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 LEADER]: Becoming Leader. State: Replica: 1bd59290fd3b46e2bcd3bbb61c123a58, State: Running, Role: LEADER
I20260923 19:36:18.393865 20439 consensus_queue.cc:237] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } }
I20260923 19:36:18.394778 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.394338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:59595)
0923 19:36:18.394515 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.394624 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260923 19:36:18.394788 20000 raft_consensus.cc:2454] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd59290fd3b46e2bcd3bbb61c123a58 in term 1.
I20260923 19:36:18.398212 19667 catalog_manager.cc:5495] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194). New cstate: current_term: 1 leader_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bd59290fd3b46e2bcd3bbb61c123a58" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 34749 } health_report { overall_health: HEALTHY } } }
I20260923 19:36:18.428145 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.421058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37690 (local address 127.12.159.194:34749)
0923 19:36:18.421217 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.421222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.421324 (+ 102us) server_negotiation.cc:407] Connection header received
0923 19:36:18.421586 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.421590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.421672 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.421864 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:18.422360 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.423105 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.425462 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.426076 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.426189 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.426793 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:18.427355 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:18.427533 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.427654 (+ 121us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.427745 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 19:36:18.432989 20000 raft_consensus.cc:1261] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Refusing update from remote peer 1bd59290fd3b46e2bcd3bbb61c123a58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:18.433434 20281 raft_consensus.cc:1261] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 1 FOLLOWER]: Refusing update from remote peer 1bd59290fd3b46e2bcd3bbb61c123a58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:18.433831 20447 consensus_queue.cc:1035] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ec1339286574c59a237f1790aae02e3" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:18.434260 20439 consensus_queue.cc:1035] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbb307c3048e491abf2eaf969fbdc021" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:18.436760 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.436195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:48703)
0923 19:36:18.436485 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.436586 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260923 19:36:18.437191 20416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.436592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:60633)
0923 19:36:18.436878 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.437007 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260923 19:36:18.451128 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.450311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:55375)
0923 19:36:18.450730 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.450859 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260}
I20260923 19:36:18.453490 20450 mvcc.cc:205] Tried to move back new op lower bound from 7332627162853797888 to 7332627162707087360. Current Snapshot: MvccSnapshot[applied={T|T < 7332627162853797888 or (T in {7332627162853797888})}]
I20260923 19:36:18.454715 20416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.454053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.195:38759)
0923 19:36:18.454351 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.454470 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260923 19:36:18.462217 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.461624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.194:54693)
0923 19:36:18.461931 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.462038 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196}
I20260923 19:36:18.463362 20417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.462625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.12.159.193:37657)
0923 19:36:18.462990 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.463113 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202}
I20260923 19:36:18.482764 19667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:18.483139 19667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:18.490226 19667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f284bb429c04c698b34668f80de70c7: Sending DeleteTablet for 3 replicas of tablet fdecbb79b6ec490d9eb3a1c2623ce53f
I20260923 19:36:18.491319 19980 tablet_service.cc:1514] Processing DeleteTablet for tablet fdecbb79b6ec490d9eb3a1c2623ce53f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:18 UTC) from {username='oryx', principal='oryx/127.12.159.253@KRBTEST.COM'} at 127.0.0.1:47744
I20260923 19:36:18.491483 20261 tablet_service.cc:1514] Processing DeleteTablet for tablet fdecbb79b6ec490d9eb3a1c2623ce53f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:18 UTC) from {username='oryx', principal='oryx/127.12.159.253@KRBTEST.COM'} at 127.0.0.1:51240
I20260923 19:36:18.494309 20120 tablet_service.cc:1514] Processing DeleteTablet for tablet fdecbb79b6ec490d9eb3a1c2623ce53f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:18 UTC) from {username='oryx', principal='oryx/127.12.159.253@KRBTEST.COM'} at 127.0.0.1:43362
I20260923 19:36:18.495848 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 19832
I20260923 19:36:18.505278 20462 tablet_replica.cc:330] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: stopping tablet replica
I20260923 19:36:18.505504 20462 raft_consensus.cc:2229] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:36:18.506280 20462 raft_consensus.cc:2258] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:18.508699 20460 tablet_replica.cc:330] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: stopping tablet replica
I20260923 19:36:18.508903 20460 raft_consensus.cc:2229] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:18.509224 20460 raft_consensus.cc:2258] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:18.509886 20461 tablet_replica.cc:330] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: stopping tablet replica
I20260923 19:36:18.510087 20462 ts_tablet_manager.cc:1905] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:18.510095 20461 raft_consensus.cc:2229] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:18.510479 20461 raft_consensus.cc:2258] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:18.511746 20460 ts_tablet_manager.cc:1905] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:18.515264 20461 ts_tablet_manager.cc:1905] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:18.518796 20460 ts_tablet_manager.cc:1918] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:18.518934 20460 log.cc:1196] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/fdecbb79b6ec490d9eb3a1c2623ce53f
I20260923 19:36:18.519439 20460 ts_tablet_manager.cc:1939] T fdecbb79b6ec490d9eb3a1c2623ce53f P 6ec1339286574c59a237f1790aae02e3: Deleting consensus metadata
I20260923 19:36:18.519448 20462 ts_tablet_manager.cc:1918] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:18.519749 20462 log.cc:1196] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/fdecbb79b6ec490d9eb3a1c2623ce53f
I20260923 19:36:18.520535 20462 ts_tablet_manager.cc:1939] T fdecbb79b6ec490d9eb3a1c2623ce53f P 1bd59290fd3b46e2bcd3bbb61c123a58: Deleting consensus metadata
I20260923 19:36:18.520772 19654 catalog_manager.cc:4841] TS 6ec1339286574c59a237f1790aae02e3 (127.12.159.193:43583): tablet fdecbb79b6ec490d9eb3a1c2623ce53f (table test-table [id=5c4f7e18a2c146dfa425f4f41769b9cd]) successfully deleted
I20260923 19:36:18.525585 19653 catalog_manager.cc:4841] TS 1bd59290fd3b46e2bcd3bbb61c123a58 (127.12.159.194:34749): tablet fdecbb79b6ec490d9eb3a1c2623ce53f (table test-table [id=5c4f7e18a2c146dfa425f4f41769b9cd]) successfully deleted
I20260923 19:36:18.532310 20461 ts_tablet_manager.cc:1918] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:18.532476 20461 log.cc:1196] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/fdecbb79b6ec490d9eb3a1c2623ce53f
I20260923 19:36:18.532948 20461 ts_tablet_manager.cc:1939] T fdecbb79b6ec490d9eb3a1c2623ce53f P dbb307c3048e491abf2eaf969fbdc021: Deleting consensus metadata
I20260923 19:36:18.534276 19655 catalog_manager.cc:4841] TS dbb307c3048e491abf2eaf969fbdc021 (127.12.159.195:33811): tablet fdecbb79b6ec490d9eb3a1c2623ce53f (table test-table [id=5c4f7e18a2c146dfa425f4f41769b9cd]) successfully deleted
I20260923 19:36:18.544044 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.496904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37434 (local address 127.12.159.193:43583)
0923 19:36:18.497117 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.497124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.514748 (+ 17624us) server_negotiation.cc:407] Connection header received
0923 19:36:18.515768 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.515774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.515871 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.515948 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:18.525166 (+ 9218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.527152 (+ 1986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.529747 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.530694 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.530829 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.535582 (+ 4753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:18.535604 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:18.535627 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:18.535672 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:18.540118 (+ 4446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:18.541159 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:18.541169 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:18.541173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:18.541335 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:18.542173 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:18.542178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:18.542181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:18.542634 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:18.542943 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.543373 (+ 430us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.543603 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:36:18.544772 20040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:18.590461 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.589961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:60338)
0923 19:36:18.590161 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.590284 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260923 19:36:18.591619 20420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.591193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36803 (local address 127.0.0.1:60350)
0923 19:36:18.591366 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:18.591455 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:36803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260923 19:36:18.639271 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 19832
I20260923 19:36:18.661396 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 20057
I20260923 19:36:18.677273 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.662271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37706 (local address 127.12.159.194:34749)
0923 19:36:18.662468 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.662474 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.662498 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:36:18.662685 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.662691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.662798 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.662910 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:18.664304 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.665631 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.667464 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.667938 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.668141 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.671263 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:18.671277 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:18.671293 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:18.671332 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:18.674457 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:18.675093 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:18.675101 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:18.675105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:18.675283 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:18.675644 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:18.675653 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:18.675656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:18.676025 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:18.676323 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.676624 (+ 301us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.676867 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:36:18.678031 20180 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:18.801996 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 20057
I20260923 19:36:18.822330 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 20198
I20260923 19:36:18.836453 20434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:18.823233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38638 (local address 127.12.159.195:33811)
0923 19:36:18.823432 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:18.823438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:18.823458 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:36:18.823542 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:18.823547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:18.823623 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:18.823733 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:18.825089 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.825924 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.827155 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:18.827566 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:18.827710 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:18.830542 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:18.830558 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:18.830576 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:18.830625 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:18.833443 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:18.834277 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:18.834287 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:18.834291 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:18.834445 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:18.834833 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:18.834838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:18.834842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:18.835219 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:18.835584 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:18.835873 (+ 289us) server_negotiation.cc:299] Negotiation successful
0923 19:36:18.836117 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:36:18.837227 20321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:18.962391 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 20198
I20260923 19:36:18.985229 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 19525
I20260923 19:36:18.986423 19699 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:19.112501 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 19525
I20260923 19:36:19.133667 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 19625
I20260923 19:36:19.135005 19893 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:19.251616 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 19625
2026-09-23T19:36:19Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11687 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:36:19 dist-test-slave-lzv7 krb5kdc[20471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:36:19 dist-test-slave-lzv7 krb5kdc[20471](info): set up 2 sockets
Sep 23 19:36:19 dist-test-slave-lzv7 krb5kdc[20471](info): commencing operation
krb5kdc: starting...
W20260923 19:36:20.354974 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.004s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:36:20 dist-test-slave-lzv7 krb5kdc[20471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:36:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:20Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab.
Entry for principal oryx/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab.
I20260923 19:36:20.582137 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38147
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab
--principal=oryx/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:38147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:20.911235 20484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:20.911589 20484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:20.911749 20484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:20.919107 20484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:20.919267 20484 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 19:36:20.919369 20484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:20.919483 20484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:20.919576 20484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:20.919664 20484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:20.929627 20484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:38147
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.254.keytab
--principal=oryx/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:20.931021 20484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:20.932430 20484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:20.944654 20489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:20.944710 20492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:20.944900 20490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:20.945067 20484 server_base.cc:1034] running on GCE node
I20260923 19:36:20.946231 20484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:20.947651 20484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:20.948983 20484 hybrid_clock.cc:648] HybridClock initialized: now 1790192180948865 us; error 52 us; skew 500 ppm
I20260923 19:36:20.949410 20484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:20 dist-test-slave-lzv7 krb5kdc[20471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192180, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:20.953208 20484 init.cc:377] Logged in from keytab as oryx/127.12.159.254@KRBTEST.COM (short username oryx)
I20260923 19:36:20.955085 20484 webserver.cc:460] Webserver started at http://127.12.159.254:35461/ using document root <none> and password file <none>
I20260923 19:36:20.955890 20484 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:20.956029 20484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:20.956434 20484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:20.959932 20484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "36128e8aca024b1bb1e4b67b4cc74e1e"
format_stamp: "Formatted at 2026-09-23 19:36:20 on dist-test-slave-lzv7"
server_key: "98e70235ed87c7af10c0841b4e4419e5"
server_key_iv: "0fd00d5037dcca215c4cb9f6868906bd"
server_key_version: "encryptionkey@0"
I20260923 19:36:20.960819 20484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "36128e8aca024b1bb1e4b67b4cc74e1e"
format_stamp: "Formatted at 2026-09-23 19:36:20 on dist-test-slave-lzv7"
server_key: "98e70235ed87c7af10c0841b4e4419e5"
server_key_iv: "0fd00d5037dcca215c4cb9f6868906bd"
server_key_version: "encryptionkey@0"
I20260923 19:36:20.966562 20484 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:36:20.970268 20499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:20.971660 20484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:36:20.971863 20484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "36128e8aca024b1bb1e4b67b4cc74e1e"
format_stamp: "Formatted at 2026-09-23 19:36:20 on dist-test-slave-lzv7"
server_key: "98e70235ed87c7af10c0841b4e4419e5"
server_key_iv: "0fd00d5037dcca215c4cb9f6868906bd"
server_key_version: "encryptionkey@0"
I20260923 19:36:20.972100 20484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:20.986208 20484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:20.990626 20484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:20.990906 20484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:21.014113 20484 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:38147
I20260923 19:36:21.014137 20560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:38147 every 8 connection(s)
I20260923 19:36:21.015619 20484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:21.019503 20561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:21.023635 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 20484
I20260923 19:36:21.023857 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:21.024529 12927 external_mini_cluster.cc:1428] Setting key b2cd281fc7aded853aeaae31646e33cf
I20260923 19:36:21.030865 20561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Bootstrap starting.
I20260923 19:36:21.034765 20561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:21.036016 20561 log.cc:824] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:21.039273 20561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: No bootstrap required, opened a new log
Sep 23 19:36:21 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:21.051106 20564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:21.026648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58404 (local address 127.12.159.254:38147)
0923 19:36:21.027579 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:21.027591 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:21.027635 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:36:21.029456 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:21.029483 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:21.029972 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:21.030317 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:21.032181 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.033757 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.035621 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.036711 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.036984 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:21.041265 (+ 4281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:21.041278 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:21.041304 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:21.041360 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:21.046033 (+ 4673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:21.046727 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:21.046748 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:21.046760 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:21.046999 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:21.047365 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:21.047370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:21.047374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:21.048209 (+ 835us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:21.048527 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:21.048965 (+ 438us) server_negotiation.cc:299] Negotiation successful
0923 19:36:21.049486 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":402,"threads_started":1}
I20260923 19:36:21.051762 20561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38147 } }
I20260923 19:36:21.052269 20561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:21.052394 20561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36128e8aca024b1bb1e4b67b4cc74e1e, State: Initialized, Role: FOLLOWER
I20260923 19:36:21.053026 20561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38147 } }
I20260923 19:36:21.053313 20561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:21.053483 20561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:21.053685 20561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:21.056329 20561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38147 } }
I20260923 19:36:21.056892 20561 leader_election.cc:302] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36128e8aca024b1bb1e4b67b4cc74e1e; no voters:
I20260923 19:36:21.057528 20561 leader_election.cc:288] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:21.057700 20566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:21.058519 20566 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [term 1 LEADER]: Becoming Leader. State: Replica: 36128e8aca024b1bb1e4b67b4cc74e1e, State: Running, Role: LEADER
I20260923 19:36:21.059085 20566 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38147 } }
I20260923 19:36:21.059926 20561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:21.062218 20568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36128e8aca024b1bb1e4b67b4cc74e1e. Latest consensus state: current_term: 1 leader_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38147 } } }
I20260923 19:36:21.062610 20568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:21.062861 20567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36128e8aca024b1bb1e4b67b4cc74e1e" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 38147 } } }
I20260923 19:36:21.063122 20567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:21.064299 20575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:21.069733 20575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:21.079919 20575 catalog_manager.cc:1347] Generated new cluster ID: 3a807a06004c42c0b9a92063d92bcca1
I20260923 19:36:21.080065 20575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:21.089129 20575 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:21.090682 20575 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:21.100304 20575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Generated new TSK 0
I20260923 19:36:21.101431 20575 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab.
Entry for principal oryx/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab.
I20260923 19:36:21.161463 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:38147
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab
--principal=oryx/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:21.495296 20587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:21.495575 20587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:21.495669 20587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:21.502936 20587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:21.503041 20587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:21.503122 20587 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:36:21.503203 20587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:21.512817 20587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab
--principal=oryx/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:38147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:21.514257 20587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:21.515538 20587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:21.529018 20592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:21.529036 20593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:21.528947 20595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:21.530023 20587 server_base.cc:1034] running on GCE node
I20260923 19:36:21.530658 20587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:21.531673 20587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:21.532929 20587 hybrid_clock.cc:648] HybridClock initialized: now 1790192181532872 us; error 50 us; skew 500 ppm
I20260923 19:36:21.533227 20587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:21 dist-test-slave-lzv7 krb5kdc[20471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192181, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:21.536327 20587 init.cc:377] Logged in from keytab as oryx/127.12.159.193@KRBTEST.COM (short username oryx)
I20260923 19:36:21.537755 20587 webserver.cc:460] Webserver started at http://127.12.159.193:44721/ using document root <none> and password file <none>
I20260923 19:36:21.538481 20587 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:21.538569 20587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:21.538846 20587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:21.541685 20587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "340284084eea4f3fb92101d5547313f0"
format_stamp: "Formatted at 2026-09-23 19:36:21 on dist-test-slave-lzv7"
server_key: "3cb450213d2da8f1bda49e51a0ae0ae8"
server_key_iv: "2ec8f32772020f7045d53f583101fc33"
server_key_version: "encryptionkey@0"
I20260923 19:36:21.542568 20587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "340284084eea4f3fb92101d5547313f0"
format_stamp: "Formatted at 2026-09-23 19:36:21 on dist-test-slave-lzv7"
server_key: "3cb450213d2da8f1bda49e51a0ae0ae8"
server_key_iv: "2ec8f32772020f7045d53f583101fc33"
server_key_version: "encryptionkey@0"
I20260923 19:36:21.547646 20587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:36:21.551024 20602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:21.552659 20587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:36:21.552841 20587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "340284084eea4f3fb92101d5547313f0"
format_stamp: "Formatted at 2026-09-23 19:36:21 on dist-test-slave-lzv7"
server_key: "3cb450213d2da8f1bda49e51a0ae0ae8"
server_key_iv: "2ec8f32772020f7045d53f583101fc33"
server_key_version: "encryptionkey@0"
I20260923 19:36:21.553040 20587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:21.570946 20587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:21.575388 20587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:21.575707 20587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:21.578697 20587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:21.578810 20587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:21.578949 20587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:21.579061 20587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:36:21 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192181, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:21.600777 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:21.579147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:46271 (local address 127.12.159.254:38147)
0923 19:36:21.581671 (+ 2524us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:21.581678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:21.581701 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:36:21.583301 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:21.583309 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:21.583396 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:21.583525 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:21.585797 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.586937 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.588561 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.588977 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.589125 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:21.593867 (+ 4742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:21.593874 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:21.593885 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:21.593917 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:21.597238 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:21.598249 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:21.598257 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:21.598262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:21.598394 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:21.598847 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:21.598852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:21.598855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:21.599163 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:21.599337 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:21.600130 (+ 793us) server_negotiation.cc:299] Negotiation successful
0923 19:36:21.600379 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2386,"thread_start_us":2281,"threads_started":1}
I20260923 19:36:21.602452 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:21.579940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38147 (local address 127.12.159.193:46271)
0923 19:36:21.580804 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:21.580849 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:21.583004 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:21.583772 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:21.583780 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:21.584562 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:21.585592 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:21.585619 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.587087 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.587093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:21.588390 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:21.588401 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.589234 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.589244 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:21.589469 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:21.590270 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:21.590296 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:21.593580 (+ 3284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:21.597413 (+ 3833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:21.597420 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:21.597434 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:21.598116 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:21.598514 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:21.598519 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:21.598523 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:21.598725 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:21.599291 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:21.599299 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:21.599697 (+ 398us) client_negotiation.cc:769] Sending connection context
0923 19:36:21.600033 (+ 336us) client_negotiation.cc:240] Negotiation successful
0923 19:36:21.600586 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":375,"threads_started":1}
I20260923 19:36:21.623982 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:21.608925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:45005 (local address 127.12.159.254:38147)
0923 19:36:21.609148 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:21.609156 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:21.609875 (+ 719us) server_negotiation.cc:407] Connection header received
0923 19:36:21.610094 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:21.610099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:21.610181 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:21.610302 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:21.611541 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.612295 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.614334 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.614767 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.614914 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:21.617549 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:21.617554 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:21.617557 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:21.617589 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:21.621055 (+ 3466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:21.621775 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:21.621783 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:21.621791 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:21.622009 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:21.622533 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:21.622537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:21.622539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:21.622820 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:21.622947 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:21.623519 (+ 572us) server_negotiation.cc:299] Negotiation successful
0923 19:36:21.623692 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:36:21.624500 20670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:21.608939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38147 (local address 127.12.159.193:45005)
0923 19:36:21.609710 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:21.609736 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:21.609950 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:21.610327 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:21.610332 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:21.610964 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:21.611369 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:21.611381 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.612462 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.612469 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:21.614166 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:21.614178 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:21.614974 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:21.614980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:21.615195 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:21.615960 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:21.615979 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:21.617323 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:21.621203 (+ 3880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:21.621209 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:21.621213 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:21.621627 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:21.622157 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:21.622165 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:21.622172 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:21.622392 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:21.622946 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:21.622954 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:21.623215 (+ 261us) client_negotiation.cc:769] Sending connection context
0923 19:36:21.623418 (+ 203us) client_negotiation.cc:240] Negotiation successful
0923 19:36:21.623852 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":398,"threads_started":1}
I20260923 19:36:21.635764 20587 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:38353
I20260923 19:36:21.635787 20722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:38353 every 8 connection(s)
I20260923 19:36:21.636965 20587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:21.639092 20723 heartbeater.cc:347] Connected to a master server at 127.12.159.254:38147
I20260923 19:36:21.639326 20723 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:21.639989 20723 heartbeater.cc:511] Master 127.12.159.254:38147 requested a full tablet report, sending...
I20260923 19:36:21.641935 20516 ts_manager.cc:194] Registered new tserver with Master: 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353)
I20260923 19:36:21.643381 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 20587
I20260923 19:36:21.643390 20516 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:46271
I20260923 19:36:21.643569 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:36:21.644227 12927 external_mini_cluster.cc:1428] Setting key 169e7a0b170782db978eb47b8a8420c2
WARNING: no policy specified for oryx/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab.
Entry for principal oryx/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab.
I20260923 19:36:21.694759 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:38147
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab
--principal=oryx/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:22.025249 20727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:22.025524 20727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:22.025689 20727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:22.033000 20727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:22.033113 20727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:22.033279 20727 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:36:22.033468 20727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:22.043365 20727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab
--principal=oryx/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:38147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:22.044657 20727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:22.046044 20727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:22.058995 20733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:22.059052 20735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:22.059013 20732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:22.059965 20727 server_base.cc:1034] running on GCE node
I20260923 19:36:22.060716 20727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:22.061720 20727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:22.063001 20727 hybrid_clock.cc:648] HybridClock initialized: now 1790192182062934 us; error 36 us; skew 500 ppm
I20260923 19:36:22.063446 20727 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192182, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:22.066969 20727 init.cc:377] Logged in from keytab as oryx/127.12.159.194@KRBTEST.COM (short username oryx)
I20260923 19:36:22.068754 20727 webserver.cc:460] Webserver started at http://127.12.159.194:45187/ using document root <none> and password file <none>
I20260923 19:36:22.069504 20727 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:22.069640 20727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:22.070077 20727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:22.073143 20727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "edb5f7bec9b040158a74f5632d6c72e5"
format_stamp: "Formatted at 2026-09-23 19:36:22 on dist-test-slave-lzv7"
server_key: "cada6bc2bfb416e882f2d20131f4d48e"
server_key_iv: "b42c9f635a91bb40daa86dee929a8f97"
server_key_version: "encryptionkey@0"
I20260923 19:36:22.074074 20727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "edb5f7bec9b040158a74f5632d6c72e5"
format_stamp: "Formatted at 2026-09-23 19:36:22 on dist-test-slave-lzv7"
server_key: "cada6bc2bfb416e882f2d20131f4d48e"
server_key_iv: "b42c9f635a91bb40daa86dee929a8f97"
server_key_version: "encryptionkey@0"
I20260923 19:36:22.079886 20727 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:36:22.083565 20742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:22.085129 20727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260923 19:36:22.085373 20727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "edb5f7bec9b040158a74f5632d6c72e5"
format_stamp: "Formatted at 2026-09-23 19:36:22 on dist-test-slave-lzv7"
server_key: "cada6bc2bfb416e882f2d20131f4d48e"
server_key_iv: "b42c9f635a91bb40daa86dee929a8f97"
server_key_version: "encryptionkey@0"
I20260923 19:36:22.085645 20727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:22.108078 20727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:22.112965 20727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:22.113270 20727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:22.116329 20727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:22.116470 20727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:22.116608 20727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:22.116685 20727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192182, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:22.144054 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.117167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:33563 (local address 127.12.159.254:38147)
0923 19:36:22.117365 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.117392 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.119082 (+ 1690us) server_negotiation.cc:407] Connection header received
0923 19:36:22.121347 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.121352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.121451 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.121596 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:22.124143 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.125727 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.128707 (+ 2980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.129244 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.129435 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.135971 (+ 6536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:22.135982 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:22.135990 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:22.136043 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:22.139845 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.141161 (+ 1316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.141167 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.141170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.141315 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.142008 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.142016 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.142022 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.142411 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:22.142595 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.143404 (+ 809us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.143656 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:36:22.145259 20751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.117968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38147 (local address 127.12.159.194:33563)
0923 19:36:22.118918 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.118959 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.121023 (+ 2064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.121935 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.121948 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.122796 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:22.123811 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.123850 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.125940 (+ 2090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.125949 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.128527 (+ 2578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.128543 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.129579 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.129591 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.130054 (+ 463us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.131173 (+ 1119us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:22.131199 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:22.135586 (+ 4387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:22.140018 (+ 4432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.140033 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.140060 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.140980 (+ 920us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.141446 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.141454 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.141461 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.141837 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.142571 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:22.142581 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:22.142992 (+ 411us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.143302 (+ 310us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.143943 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":476,"threads_started":1}
I20260923 19:36:22.168809 20814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.153195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38147 (local address 127.12.159.194:41777)
0923 19:36:22.154082 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.154108 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.154314 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.154762 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.154766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.155272 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:22.155569 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.155579 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.156769 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.156775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.158024 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.158037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.159041 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.159047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.159219 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.160029 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:22.160047 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:22.160982 (+ 935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:22.164861 (+ 3879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.164867 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.164875 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.165650 (+ 775us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.166229 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.166236 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.166248 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.166468 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.167340 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:22.167345 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:22.167635 (+ 290us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.167839 (+ 204us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.168260 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":411,"threads_started":1}
I20260923 19:36:22.169621 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.153117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:41777 (local address 127.12.159.254:38147)
0923 19:36:22.153338 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.153347 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.154224 (+ 877us) server_negotiation.cc:407] Connection header received
0923 19:36:22.154505 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.154509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.154575 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.154725 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:22.155718 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.156620 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.158182 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.158809 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.158967 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.161174 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:22.161179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:22.161182 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:22.161215 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:22.164682 (+ 3467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.165800 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.165838 (+ 38us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.165841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.166003 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.166637 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.166662 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.166667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.167184 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:22.167369 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.169190 (+ 1821us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.169411 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:36:22.179476 20727 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:37505
I20260923 19:36:22.179519 20861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:37505 every 8 connection(s)
I20260923 19:36:22.180860 20727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:22.183143 20862 heartbeater.cc:347] Connected to a master server at 127.12.159.254:38147
I20260923 19:36:22.183496 20862 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:22.184183 20862 heartbeater.cc:511] Master 127.12.159.254:38147 requested a full tablet report, sending...
I20260923 19:36:22.185602 20516 ts_manager.cc:194] Registered new tserver with Master: edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505)
I20260923 19:36:22.186548 20516 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:33563
I20260923 19:36:22.186848 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 20727
I20260923 19:36:22.187047 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:36:22.187534 12927 external_mini_cluster.cc:1428] Setting key e0f041e8959e3cc2a8d8f82b1bdefea4
WARNING: no policy specified for oryx/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab.
Entry for principal oryx/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab.
I20260923 19:36:22.238536 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:38147
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab
--principal=oryx/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:22.572885 20866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:22.573173 20866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:22.573336 20866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:22.580947 20866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:22.581153 20866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:22.581315 20866 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:36:22.581480 20866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:22.592491 20866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab
--principal=oryx/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.159.254:38147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:22.593796 20866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:22.595207 20866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:22.609184 20871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:22.609205 20872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:22.609139 20874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:22.610329 20866 server_base.cc:1034] running on GCE node
I20260923 19:36:22.611008 20866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:22.611951 20866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:22.613169 20866 hybrid_clock.cc:648] HybridClock initialized: now 1790192182613103 us; error 36 us; skew 500 ppm
I20260923 19:36:22.613482 20866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192182, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:22.616707 20866 init.cc:377] Logged in from keytab as oryx/127.12.159.195@KRBTEST.COM (short username oryx)
I20260923 19:36:22.618347 20866 webserver.cc:460] Webserver started at http://127.12.159.195:45023/ using document root <none> and password file <none>
I20260923 19:36:22.619051 20866 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:22.619161 20866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:22.619495 20866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:22.622429 20866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "7e456b2b00ef4664a8f0a714e7bfc74d"
format_stamp: "Formatted at 2026-09-23 19:36:22 on dist-test-slave-lzv7"
server_key: "d085f9ffbbdd1669400c39624a5dcb8c"
server_key_iv: "c3a24f599f517cb5c72aff5e91378189"
server_key_version: "encryptionkey@0"
I20260923 19:36:22.623237 20866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "7e456b2b00ef4664a8f0a714e7bfc74d"
format_stamp: "Formatted at 2026-09-23 19:36:22 on dist-test-slave-lzv7"
server_key: "d085f9ffbbdd1669400c39624a5dcb8c"
server_key_iv: "c3a24f599f517cb5c72aff5e91378189"
server_key_version: "encryptionkey@0"
I20260923 19:36:22.628407 20866 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:36:22.631966 20881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:22.633301 20866 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:36:22.633461 20866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "7e456b2b00ef4664a8f0a714e7bfc74d"
format_stamp: "Formatted at 2026-09-23 19:36:22 on dist-test-slave-lzv7"
server_key: "d085f9ffbbdd1669400c39624a5dcb8c"
server_key_iv: "c3a24f599f517cb5c72aff5e91378189"
server_key_version: "encryptionkey@0"
I20260923 19:36:22.633667 20866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:22.646692 20723 heartbeater.cc:503] Master 127.12.159.254:38147 was elected leader, sending a full tablet report...
I20260923 19:36:22.647902 20866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:22.652446 20866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:22.652735 20866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:22.655743 20866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:22.655855 20866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:22.656013 20866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:22.656086 20866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192182, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:22.684352 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.656458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:51527 (local address 127.12.159.254:38147)
0923 19:36:22.656647 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.656653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.658251 (+ 1598us) server_negotiation.cc:407] Connection header received
0923 19:36:22.661537 (+ 3286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.661546 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.661651 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.661778 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:22.664622 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.665625 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.669029 (+ 3404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.669825 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.669995 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.675362 (+ 5367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:22.675369 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:22.675375 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:22.675433 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:22.679833 (+ 4400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.681076 (+ 1243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.681083 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.681087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.681267 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.681959 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.681967 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.681972 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.682391 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:22.682586 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.683481 (+ 895us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.683816 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:36:22.684938 20890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.657087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38147 (local address 127.12.159.195:51527)
0923 19:36:22.658065 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.658124 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.661066 (+ 2942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.662165 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.662178 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.663239 (+ 1061us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:22.664387 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.664425 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.665903 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.665912 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.668737 (+ 2825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.668773 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.670117 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.670127 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.670495 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.671548 (+ 1053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:22.671596 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:22.675080 (+ 3484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:22.680043 (+ 4963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.680061 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.680087 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.680892 (+ 805us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.681412 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.681422 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.681426 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.681761 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.682543 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:22.682555 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:22.682977 (+ 422us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.683233 (+ 256us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.683658 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":398,"threads_started":1}
I20260923 19:36:22.701725 20866 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:33895
I20260923 19:36:22.701839 21000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:33895 every 8 connection(s)
I20260923 19:36:22.703052 20866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:22.705549 21001 heartbeater.cc:347] Connected to a master server at 127.12.159.254:38147
I20260923 19:36:22.705866 21001 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:22.706666 21001 heartbeater.cc:511] Master 127.12.159.254:38147 requested a full tablet report, sending...
I20260923 19:36:22.707707 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.692446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:49871 (local address 127.12.159.254:38147)
0923 19:36:22.692694 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.692703 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.693276 (+ 573us) server_negotiation.cc:407] Connection header received
0923 19:36:22.693504 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.693510 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.693583 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.693691 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:22.695260 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.695956 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.698082 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.698670 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.698809 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.701593 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:22.701602 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:22.701610 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:22.701656 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:22.704876 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.705671 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.705679 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.705683 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.705877 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.706310 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.706314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.706316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.706591 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:22.706702 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.707171 (+ 469us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.707352 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:36:22.707942 20981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.692455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38147 (local address 127.12.159.195:49871)
0923 19:36:22.693157 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.693180 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.693349 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.693722 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.693726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.694397 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:22.695104 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.695116 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.696094 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.696102 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.697923 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.697935 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.698932 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.698941 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.699252 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.699988 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:22.700045 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:22.701353 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:22.705009 (+ 3656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.705014 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.705019 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.705557 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.706035 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:22.706040 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:22.706043 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:22.706202 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:22.706711 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:22.706716 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:22.706923 (+ 207us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.707080 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.707435 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":382,"threads_started":1}
I20260923 19:36:22.708251 20516 ts_manager.cc:194] Registered new tserver with Master: 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895)
I20260923 19:36:22.709326 20516 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:51527
I20260923 19:36:22.710518 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 20866
I20260923 19:36:22.710691 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:36:22.711282 12927 external_mini_cluster.cc:1428] Setting key faafd3d591f73c436a2613486077e1a6
I20260923 19:36:22.714564 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192182, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:36:22.764789 20611 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:22.753640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.12.159.254:38147)
0923 19:36:22.753923 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.753932 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.754097 (+ 165us) server_negotiation.cc:407] Connection header received
0923 19:36:22.754250 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.754254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.754320 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.754407 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:22.755838 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.756696 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.758195 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.758638 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.758763 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.764469 (+ 5706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58416: BlockingRecv error: recv got EOF from 127.0.0.1:58416 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Sep 23 19:36:22 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192182, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:22.783075 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.768052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58420 (local address 127.12.159.254:38147)
0923 19:36:22.768305 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.768311 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.768594 (+ 283us) server_negotiation.cc:407] Connection header received
0923 19:36:22.768798 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.768803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.768879 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.768984 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:22.770164 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.770899 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.772090 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.772537 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.772664 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.776535 (+ 3871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:22.776540 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:22.776543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:22.776575 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:22.780001 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.780805 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.780811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.780815 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.780960 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:22.781374 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:22.781378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:22.781381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:22.781690 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:22.782014 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.782521 (+ 507us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.782740 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 19:36:22.789620 20516 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:36:22.796598 20516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:22.821687 21019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.809099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:38353 (local address 127.0.0.1:59964)
0923 19:36:22.810655 (+ 1556us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.810695 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.810854 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.811869 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.811880 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.811931 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:22.812382 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.812397 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.814710 (+ 2313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.814718 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.817596 (+ 2878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.817615 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.820400 (+ 2785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.820407 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.820704 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.820773 (+ 69us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.820933 (+ 160us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.821182 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1312,"thread_start_us":1169,"threads_started":1}
I20260923 19:36:22.823002 21020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.809278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.12.159.193:38353)
0923 19:36:22.810216 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.810229 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.811047 (+ 818us) server_negotiation.cc:407] Connection header received
0923 19:36:22.811154 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.811161 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.811427 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.811619 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:22.812617 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.814531 (+ 1914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.817826 (+ 3295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.819785 (+ 1959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.820007 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.820226 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.822370 (+ 2144us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.822599 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":812,"threads_started":1}
I20260923 19:36:22.827661 20653 tablet_service.cc:1467] Processing CreateTablet for tablet b12a2abf5fd64e3bbfddc90464cf8315 (DEFAULT_TABLE table=test-table [id=c63321c977af47048a5214fcae996074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:22.829164 20653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b12a2abf5fd64e3bbfddc90464cf8315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:22.832374 21019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.809670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:37505 (local address 127.0.0.1:38736)
0923 19:36:22.822042 (+ 12372us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.822066 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.822187 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.825292 (+ 3105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.825296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.825320 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:22.825538 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.825549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.827256 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.827261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.829275 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.829289 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.831279 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.831287 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.831640 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.831761 (+ 121us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.831860 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.832029 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12240,"mutex_wait_us":133,"thread_start_us":13686,"threads_started":1}
I20260923 19:36:22.832396 21022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.809902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38736 (local address 127.12.159.194:37505)
0923 19:36:22.822676 (+ 12774us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.822690 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.822729 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:36:22.822855 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.822867 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.825086 (+ 2219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.825274 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:22.825694 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.827074 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.829421 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.830797 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.830977 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.831176 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.831930 (+ 754us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.832106 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12531,"thread_start_us":15113,"threads_started":1}
I20260923 19:36:22.832444 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.811590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46264 (local address 127.12.159.195:33895)
0923 19:36:22.824196 (+ 12606us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.824202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.824228 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:36:22.824309 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.824314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.824490 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.824705 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:22.825291 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.826871 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.829003 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.830865 (+ 1862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.831030 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.831176 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.831974 (+ 798us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.832128 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12424,"thread_start_us":13127,"threads_started":1}
I20260923 19:36:22.833179 21021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.811023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33895 (local address 127.0.0.1:46264)
0923 19:36:22.823680 (+ 12657us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.823698 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.823809 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.824687 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.824692 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.824717 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:22.825078 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.825090 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.827045 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.827050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.828844 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.828856 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.831310 (+ 2454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.831315 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.831643 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.831761 (+ 118us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.831860 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.832809 (+ 949us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12528,"mutex_wait_us":1066,"thread_start_us":12541,"threads_started":1}
I20260923 19:36:22.836197 20931 tablet_service.cc:1467] Processing CreateTablet for tablet b12a2abf5fd64e3bbfddc90464cf8315 (DEFAULT_TABLE table=test-table [id=c63321c977af47048a5214fcae996074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:22.836433 20792 tablet_service.cc:1467] Processing CreateTablet for tablet b12a2abf5fd64e3bbfddc90464cf8315 (DEFAULT_TABLE table=test-table [id=c63321c977af47048a5214fcae996074]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:22.837581 20931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b12a2abf5fd64e3bbfddc90464cf8315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:22.837759 20792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b12a2abf5fd64e3bbfddc90464cf8315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:22.843712 21025 tablet_bootstrap.cc:492] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Bootstrap starting.
I20260923 19:36:22.847492 21025 tablet_bootstrap.cc:654] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:22.849323 21025 log.cc:824] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:22.851528 21028 tablet_bootstrap.cc:492] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Bootstrap starting.
I20260923 19:36:22.852610 21025 tablet_bootstrap.cc:492] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: No bootstrap required, opened a new log
I20260923 19:36:22.852893 21025 ts_tablet_manager.cc:1397] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260923 19:36:22.854792 21028 tablet_bootstrap.cc:654] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:22.855782 21028 log.cc:824] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:22.856720 21027 tablet_bootstrap.cc:492] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Bootstrap starting.
I20260923 19:36:22.859186 21028 tablet_bootstrap.cc:492] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: No bootstrap required, opened a new log
I20260923 19:36:22.859527 21028 ts_tablet_manager.cc:1397] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20260923 19:36:22.860255 21027 tablet_bootstrap.cc:654] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:22.861500 21027 log.cc:824] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:22.862177 21025 raft_consensus.cc:348] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.862602 21025 raft_consensus.cc:374] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:22.862727 21025 raft_consensus.cc:729] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340284084eea4f3fb92101d5547313f0, State: Initialized, Role: FOLLOWER
I20260923 19:36:22.863319 21025 consensus_queue.cc:260] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.864936 21025 ts_tablet_manager.cc:1428] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260923 19:36:22.868475 21027 tablet_bootstrap.cc:492] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: No bootstrap required, opened a new log
I20260923 19:36:22.868781 21027 ts_tablet_manager.cc:1397] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.000s
I20260923 19:36:22.870033 21028 raft_consensus.cc:348] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.870505 21028 raft_consensus.cc:374] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:22.870600 21028 raft_consensus.cc:729] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Initialized, Role: FOLLOWER
I20260923 19:36:22.871258 21028 consensus_queue.cc:260] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.872344 21001 heartbeater.cc:503] Master 127.12.159.254:38147 was elected leader, sending a full tablet report...
I20260923 19:36:22.872853 21028 ts_tablet_manager.cc:1428] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260923 19:36:22.877887 21027 raft_consensus.cc:348] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.878260 21027 raft_consensus.cc:374] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:22.878355 21027 raft_consensus.cc:729] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb5f7bec9b040158a74f5632d6c72e5, State: Initialized, Role: FOLLOWER
I20260923 19:36:22.878954 21027 consensus_queue.cc:260] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.880009 20862 heartbeater.cc:503] Master 127.12.159.254:38147 was elected leader, sending a full tablet report...
I20260923 19:36:22.880661 21027 ts_tablet_manager.cc:1428] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
W20260923 19:36:22.889637 20724 tablet.cc:2369] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:36:22.907243 21033 raft_consensus.cc:482] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:22.907568 21033 raft_consensus.cc:504] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.909258 21033 leader_election.cc:288] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895)
I20260923 19:36:22.916946 21020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.909883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:54809 (local address 127.12.159.193:38353)
0923 19:36:22.910154 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.910161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.910526 (+ 365us) server_negotiation.cc:407] Connection header received
0923 19:36:22.910827 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.910832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.910905 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.910970 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:22.911866 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.912877 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.914930 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.915936 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.916061 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.916114 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.916562 (+ 448us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.916702 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260923 19:36:22.916977 21034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.909699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:38353 (local address 127.12.159.194:54809)
0923 19:36:22.910405 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.910426 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.910648 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.911169 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.911176 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.911209 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:22.911661 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.911673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.913009 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.913015 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.914758 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.914769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.916150 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.916156 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.916325 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.916364 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.916485 (+ 121us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.916640 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":339,"threads_started":1}
I20260923 19:36:22.917450 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.910722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:55059 (local address 127.12.159.195:33895)
0923 19:36:22.910915 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.910920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.911320 (+ 400us) server_negotiation.cc:407] Connection header received
0923 19:36:22.911679 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.911684 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.911768 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.911861 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:22.912527 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.913410 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.915485 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.916430 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.916576 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.916642 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.917050 (+ 408us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.917209 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:36:22.917464 21035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.910602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33895 (local address 127.12.159.194:55059)
0923 19:36:22.911224 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:22.911243 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:22.911442 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:22.911939 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:22.911946 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:22.911978 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:22.912373 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.912384 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.913573 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.913577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.915323 (+ 1746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:22.915337 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.916643 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.916659 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:22.916836 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.916867 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:36:22.916984 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 19:36:22.917113 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":319,"threads_started":1}
I20260923 19:36:22.918084 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b12a2abf5fd64e3bbfddc90464cf8315" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0" is_pre_election: true
I20260923 19:36:22.918322 20951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b12a2abf5fd64e3bbfddc90464cf8315" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" is_pre_election: true
I20260923 19:36:22.918601 20678 raft_consensus.cc:2454] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 0.
I20260923 19:36:22.918895 20951 raft_consensus.cc:2454] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 0.
I20260923 19:36:22.919334 20745 leader_election.cc:302] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, edb5f7bec9b040158a74f5632d6c72e5; no voters:
I20260923 19:36:22.919720 21033 raft_consensus.cc:2781] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:22.919878 21033 raft_consensus.cc:482] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:22.920004 21033 raft_consensus.cc:3037] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:22.922542 21033 raft_consensus.cc:504] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
I20260923 19:36:22.923182 21033 leader_election.cc:288] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 election: Requested vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895)
I20260923 19:36:22.923681 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b12a2abf5fd64e3bbfddc90464cf8315" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0"
I20260923 19:36:22.923734 20951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b12a2abf5fd64e3bbfddc90464cf8315" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d"
I20260923 19:36:22.923907 20678 raft_consensus.cc:3037] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:22.923924 20951 raft_consensus.cc:3037] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:22.927218 20951 raft_consensus.cc:2454] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 1.
I20260923 19:36:22.927218 20678 raft_consensus.cc:2454] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 1.
I20260923 19:36:22.927646 20745 leader_election.cc:302] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, edb5f7bec9b040158a74f5632d6c72e5; no voters:
I20260923 19:36:22.927938 21033 raft_consensus.cc:2781] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:22.928385 21033 raft_consensus.cc:686] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 LEADER]: Becoming Leader. State: Replica: edb5f7bec9b040158a74f5632d6c72e5, State: Running, Role: LEADER
I20260923 19:36:22.928871 21033 consensus_queue.cc:237] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } }
W20260923 19:36:22.933045 20863 tablet.cc:2369] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:36:22.934083 20515 catalog_manager.cc:5495] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194). New cstate: current_term: 1 leader_uuid: "edb5f7bec9b040158a74f5632d6c72e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } health_report { overall_health: HEALTHY } } }
W20260923 19:36:22.954881 21002 tablet.cc:2369] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:36:22.968258 21022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:22.962837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38742 (local address 127.12.159.194:37505)
0923 19:36:22.963089 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:22.963098 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:22.963118 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:36:22.963353 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:22.963357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:22.963436 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:22.963613 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:22.963959 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.964717 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.966182 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:22.966576 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:22.966717 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:22.967157 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:22.967691 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:22.967845 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:22.967901 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 19:36:22.967993 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:36:22.976632 20678 raft_consensus.cc:1261] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Refusing update from remote peer edb5f7bec9b040158a74f5632d6c72e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:22.976632 20951 raft_consensus.cc:1261] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Refusing update from remote peer edb5f7bec9b040158a74f5632d6c72e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:22.977746 21036 consensus_queue.cc:1035] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:22.978173 21033 consensus_queue.cc:1035] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:22.991729 21041 mvcc.cc:205] Tried to move back new op lower bound from 7332627181462020096 to 7332627181280710656. Current Snapshot: MvccSnapshot[applied={T|T < 7332627181462020096}]
I20260923 19:36:23.004626 20515 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:23.004945 20515 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:23.008942 20515 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Sending DeleteTablet for 3 replicas of tablet b12a2abf5fd64e3bbfddc90464cf8315
I20260923 19:36:23.010303 20792 tablet_service.cc:1514] Processing DeleteTablet for tablet b12a2abf5fd64e3bbfddc90464cf8315 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:22 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:38736
I20260923 19:36:23.010303 20931 tablet_service.cc:1514] Processing DeleteTablet for tablet b12a2abf5fd64e3bbfddc90464cf8315 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:22 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:46264
I20260923 19:36:23.011091 20653 tablet_service.cc:1514] Processing DeleteTablet for tablet b12a2abf5fd64e3bbfddc90464cf8315 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:22 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:59964
I20260923 19:36:23.011296 21050 tablet_replica.cc:330] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: stopping tablet replica
I20260923 19:36:23.011552 20515 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:36:23.011768 21050 raft_consensus.cc:2229] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:23.012290 21050 raft_consensus.cc:2258] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:36:23.012538 20515 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:23.013386 21049 tablet_replica.cc:330] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: stopping tablet replica
I20260923 19:36:23.013859 21049 raft_consensus.cc:2229] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:36:23.016297 21050 ts_tablet_manager.cc:1905] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.018312 21051 tablet_replica.cc:330] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: stopping tablet replica
I20260923 19:36:23.018711 21051 raft_consensus.cc:2229] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:23.019186 21051 raft_consensus.cc:2258] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.021580 20653 tablet_service.cc:1467] Processing CreateTablet for tablet 7896a6b33cbc4012b2d1237f08036077 (DEFAULT_TABLE table=test-table [id=423d300ace044c95b85da63adc4b4870]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:23.022047 20653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7896a6b33cbc4012b2d1237f08036077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.022073 20792 tablet_service.cc:1467] Processing CreateTablet for tablet 7896a6b33cbc4012b2d1237f08036077 (DEFAULT_TABLE table=test-table [id=423d300ace044c95b85da63adc4b4870]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:23.022599 20792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7896a6b33cbc4012b2d1237f08036077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.026208 20931 tablet_service.cc:1467] Processing CreateTablet for tablet 7896a6b33cbc4012b2d1237f08036077 (DEFAULT_TABLE table=test-table [id=423d300ace044c95b85da63adc4b4870]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:23.026712 20931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7896a6b33cbc4012b2d1237f08036077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.029963 21027 tablet_bootstrap.cc:492] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: Bootstrap starting.
I20260923 19:36:23.030467 21049 raft_consensus.cc:2258] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.034077 21028 tablet_bootstrap.cc:492] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: Bootstrap starting.
I20260923 19:36:23.034390 21050 ts_tablet_manager.cc:1918] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:23.034628 21050 log.cc:1196] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/b12a2abf5fd64e3bbfddc90464cf8315
I20260923 19:36:23.035373 21050 ts_tablet_manager.cc:1939] T b12a2abf5fd64e3bbfddc90464cf8315 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting consensus metadata
I20260923 19:36:23.035543 21027 tablet_bootstrap.cc:654] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.035761 21028 tablet_bootstrap.cc:654] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.037716 20502 catalog_manager.cc:4841] TS 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895): tablet b12a2abf5fd64e3bbfddc90464cf8315 (table test-table [id=c63321c977af47048a5214fcae996074]) successfully deleted
I20260923 19:36:23.039252 21049 ts_tablet_manager.cc:1905] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.040581 21025 tablet_bootstrap.cc:492] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: Bootstrap starting.
I20260923 19:36:23.042815 21025 tablet_bootstrap.cc:654] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.045367 21025 tablet_bootstrap.cc:492] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: No bootstrap required, opened a new log
I20260923 19:36:23.045560 21025 ts_tablet_manager.cc:1397] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 19:36:23.046635 21025 raft_consensus.cc:348] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.046947 21025 raft_consensus.cc:374] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.047070 21025 raft_consensus.cc:729] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340284084eea4f3fb92101d5547313f0, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.047468 21025 consensus_queue.cc:260] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.051393 21025 ts_tablet_manager.cc:1428] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260923 19:36:23.053297 21051 ts_tablet_manager.cc:1905] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.054420 21027 tablet_bootstrap.cc:492] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: No bootstrap required, opened a new log
I20260923 19:36:23.054605 21027 ts_tablet_manager.cc:1397] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.016s
I20260923 19:36:23.055452 21027 raft_consensus.cc:348] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.055680 21027 raft_consensus.cc:374] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.055778 21027 raft_consensus.cc:729] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb5f7bec9b040158a74f5632d6c72e5, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.056049 21027 consensus_queue.cc:260] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.059496 21027 ts_tablet_manager.cc:1428] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:36:23.059635 21049 ts_tablet_manager.cc:1918] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:23.059921 21049 log.cc:1196] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/b12a2abf5fd64e3bbfddc90464cf8315
I20260923 19:36:23.060598 21049 ts_tablet_manager.cc:1939] T b12a2abf5fd64e3bbfddc90464cf8315 P edb5f7bec9b040158a74f5632d6c72e5: Deleting consensus metadata
I20260923 19:36:23.061127 21051 ts_tablet_manager.cc:1918] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:23.061302 21051 log.cc:1196] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/b12a2abf5fd64e3bbfddc90464cf8315
I20260923 19:36:23.061898 21051 ts_tablet_manager.cc:1939] T b12a2abf5fd64e3bbfddc90464cf8315 P 340284084eea4f3fb92101d5547313f0: Deleting consensus metadata
I20260923 19:36:23.063947 20502 catalog_manager.cc:4841] TS 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353): tablet b12a2abf5fd64e3bbfddc90464cf8315 (table test-table [id=c63321c977af47048a5214fcae996074]) successfully deleted
I20260923 19:36:23.064975 20501 catalog_manager.cc:4841] TS edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505): tablet b12a2abf5fd64e3bbfddc90464cf8315 (table test-table [id=c63321c977af47048a5214fcae996074]) successfully deleted
I20260923 19:36:23.065826 21028 tablet_bootstrap.cc:492] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: No bootstrap required, opened a new log
I20260923 19:36:23.066007 21028 ts_tablet_manager.cc:1397] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.001s
I20260923 19:36:23.066942 21028 raft_consensus.cc:348] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.067203 21028 raft_consensus.cc:374] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.067313 21028 raft_consensus.cc:729] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.067623 21028 consensus_queue.cc:260] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.068320 21028 ts_tablet_manager.cc:1428] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:36:23.124158 21032 raft_consensus.cc:482] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:23.124445 21032 raft_consensus.cc:504] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.126605 21032 leader_election.cc:288] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505)
I20260923 19:36:23.133369 21020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.127035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:43467 (local address 127.12.159.193:38353)
0923 19:36:23.127389 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.127394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.127413 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:36:23.127629 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.127636 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.127720 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.127803 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:23.128367 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.129360 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.131620 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.132419 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.132607 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.132684 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.132954 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.133080 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234}
I20260923 19:36:23.133409 20890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.126990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:38353 (local address 127.12.159.195:43467)
0923 19:36:23.127289 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:23.127309 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:23.127432 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:23.127980 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:23.127986 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:23.128035 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:23.128233 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.128241 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.129484 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.129492 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.131466 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.131478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.132595 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.132601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.132793 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.132819 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 19:36:23.132929 (+ 110us) client_negotiation.cc:240] Negotiation successful
0923 19:36:23.133077 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":58,"spinlock_wait_cycles":33920}
I20260923 19:36:23.134080 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7896a6b33cbc4012b2d1237f08036077" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0" is_pre_election: true
I20260923 19:36:23.134331 20678 raft_consensus.cc:2454] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 0.
I20260923 19:36:23.134856 20884 leader_election.cc:302] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, 7e456b2b00ef4664a8f0a714e7bfc74d; no voters:
I20260923 19:36:23.135378 21032 raft_consensus.cc:2781] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:23.135530 21032 raft_consensus.cc:482] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:23.135689 21032 raft_consensus.cc:3037] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.135864 21022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.126985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:56703 (local address 127.12.159.194:37505)
0923 19:36:23.127243 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.127250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.128010 (+ 760us) server_negotiation.cc:407] Connection header received
0923 19:36:23.128167 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.128174 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.128258 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.128369 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:23.128979 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.130280 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.133248 (+ 2968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.134751 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.134906 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.134997 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.135408 (+ 411us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.135551 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260923 19:36:23.135982 21055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.127191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:37505 (local address 127.12.159.195:56703)
0923 19:36:23.127895 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:23.127913 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:23.128033 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:23.128407 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:23.128414 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:23.128445 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:23.128798 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.128809 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.130459 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.130466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.133030 (+ 2564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.133048 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.134992 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.134999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.135176 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.135209 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 19:36:23.135379 (+ 170us) client_negotiation.cc:240] Negotiation successful
0923 19:36:23.135534 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":36,"spinlock_wait_cycles":1792,"thread_start_us":389,"threads_started":1}
I20260923 19:36:23.136915 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7896a6b33cbc4012b2d1237f08036077" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb5f7bec9b040158a74f5632d6c72e5" is_pre_election: true
I20260923 19:36:23.137427 20817 raft_consensus.cc:2454] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 0.
I20260923 19:36:23.139268 21032 raft_consensus.cc:504] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.140094 21032 leader_election.cc:288] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 election: Requested vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505)
I20260923 19:36:23.140553 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7896a6b33cbc4012b2d1237f08036077" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb5f7bec9b040158a74f5632d6c72e5"
I20260923 19:36:23.140599 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7896a6b33cbc4012b2d1237f08036077" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0"
I20260923 19:36:23.140746 20817 raft_consensus.cc:3037] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.140834 20678 raft_consensus.cc:3037] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.143327 20817 raft_consensus.cc:2454] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 1.
I20260923 19:36:23.143790 20883 leader_election.cc:302] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e456b2b00ef4664a8f0a714e7bfc74d, edb5f7bec9b040158a74f5632d6c72e5; no voters:
I20260923 19:36:23.144129 21032 raft_consensus.cc:2781] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:23.144264 20678 raft_consensus.cc:2454] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 1.
I20260923 19:36:23.144673 21032 raft_consensus.cc:686] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 LEADER]: Becoming Leader. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Running, Role: LEADER
I20260923 19:36:23.145092 21032 consensus_queue.cc:237] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.148952 20515 catalog_manager.cc:5495] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195). New cstate: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } health_report { overall_health: HEALTHY } } }
Sep 23 19:36:23 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192180, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.254@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:23.210269 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.188817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.12.159.254:38147)
0923 19:36:23.189032 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.189040 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.189869 (+ 829us) server_negotiation.cc:407] Connection header received
0923 19:36:23.190094 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.190100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.190181 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.190281 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:23.192069 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.193264 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.195368 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.195990 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.196116 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.204325 (+ 8209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:23.204329 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:23.204338 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:23.204369 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:23.207335 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:23.208093 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:23.208105 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:23.208108 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:23.208219 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:23.208612 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:23.208617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:23.208620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:23.208887 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:23.209062 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.209527 (+ 465us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.209888 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":117,"server-negotiator.queue_time_us":63}
I20260923 19:36:23.210317 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.188943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:38147 (local address 127.0.0.1:58428)
0923 19:36:23.189717 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:23.189739 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:23.189954 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:23.190400 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:23.190406 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:23.191486 (+ 1080us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:23.191884 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.191898 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.193432 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.193441 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.195210 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.195225 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.196203 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.196212 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.196427 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.201084 (+ 4657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:23.201114 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:23.204103 (+ 2989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:23.207483 (+ 3380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:23.207510 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:23.207518 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:23.207968 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:23.208327 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:23.208333 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:23.208336 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:23.208470 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:23.209042 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:23.209050 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:23.209226 (+ 176us) client_negotiation.cc:769] Sending connection context
0923 19:36:23.209384 (+ 158us) client_negotiation.cc:240] Negotiation successful
0923 19:36:23.209720 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":441,"threads_started":1}
I20260923 19:36:23.216070 20515 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:58428:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 19:36:23.217221 20515 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:23.224632 20653 tablet_service.cc:1467] Processing CreateTablet for tablet 054d278cb831424b89a442c211b5c339 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2d2de9205a546d2bad4d0b06c23a843]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:36:23.225239 20653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054d278cb831424b89a442c211b5c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.225106 20792 tablet_service.cc:1467] Processing CreateTablet for tablet 054d278cb831424b89a442c211b5c339 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2d2de9205a546d2bad4d0b06c23a843]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:36:23.225726 20792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054d278cb831424b89a442c211b5c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.226663 20931 tablet_service.cc:1467] Processing CreateTablet for tablet 054d278cb831424b89a442c211b5c339 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2d2de9205a546d2bad4d0b06c23a843]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:36:23.227173 20931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054d278cb831424b89a442c211b5c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.232465 21025 tablet_bootstrap.cc:492] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: Bootstrap starting.
I20260923 19:36:23.234023 21028 tablet_bootstrap.cc:492] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: Bootstrap starting.
I20260923 19:36:23.234192 21025 tablet_bootstrap.cc:654] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.235775 21028 tablet_bootstrap.cc:654] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.237354 21027 tablet_bootstrap.cc:492] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: Bootstrap starting.
I20260923 19:36:23.237988 21028 tablet_bootstrap.cc:492] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: No bootstrap required, opened a new log
I20260923 19:36:23.238158 21028 ts_tablet_manager.cc:1397] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:36:23.238898 21028 raft_consensus.cc:348] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.239167 21027 tablet_bootstrap.cc:654] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.239172 21028 raft_consensus.cc:374] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.239239 21028 raft_consensus.cc:729] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.239470 21028 consensus_queue.cc:260] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.240041 21028 ts_tablet_manager.cc:1428] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:36:23.239950 21032 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.240271 21032 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:36:23.243206 21025 tablet_bootstrap.cc:492] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: No bootstrap required, opened a new log
I20260923 19:36:23.243376 21025 ts_tablet_manager.cc:1397] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260923 19:36:23.244051 21025 raft_consensus.cc:348] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.244262 21025 raft_consensus.cc:374] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.244369 21025 raft_consensus.cc:729] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340284084eea4f3fb92101d5547313f0, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.244633 21025 consensus_queue.cc:260] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.245059 21031 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.245432 21031 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:36:23.246031 21025 ts_tablet_manager.cc:1428] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:36:23.247530 21027 tablet_bootstrap.cc:492] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: No bootstrap required, opened a new log
I20260923 19:36:23.247789 21027 ts_tablet_manager.cc:1397] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260923 19:36:23.248765 21027 raft_consensus.cc:348] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.249122 21027 raft_consensus.cc:374] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.249228 21027 raft_consensus.cc:729] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb5f7bec9b040158a74f5632d6c72e5, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.249495 21027 consensus_queue.cc:260] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.250057 21033 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.250358 21033 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:36:23.250895 21027 ts_tablet_manager.cc:1428] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:36:23.302822 21032 raft_consensus.cc:482] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:23.303057 21032 raft_consensus.cc:504] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.303851 21032 leader_election.cc:288] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505)
I20260923 19:36:23.304463 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054d278cb831424b89a442c211b5c339" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0" is_pre_election: true
I20260923 19:36:23.304517 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054d278cb831424b89a442c211b5c339" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb5f7bec9b040158a74f5632d6c72e5" is_pre_election: true
I20260923 19:36:23.304744 20678 raft_consensus.cc:2454] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 0.
I20260923 19:36:23.304927 20817 raft_consensus.cc:2454] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 0.
I20260923 19:36:23.305294 20884 leader_election.cc:302] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, 7e456b2b00ef4664a8f0a714e7bfc74d; no voters:
I20260923 19:36:23.305621 21032 raft_consensus.cc:2781] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:23.305721 21032 raft_consensus.cc:482] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:23.305909 21032 raft_consensus.cc:3037] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.308099 21032 raft_consensus.cc:504] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.308748 21032 leader_election.cc:288] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 election: Requested vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505)
I20260923 19:36:23.309248 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054d278cb831424b89a442c211b5c339" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0"
I20260923 19:36:23.309368 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "054d278cb831424b89a442c211b5c339" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb5f7bec9b040158a74f5632d6c72e5"
I20260923 19:36:23.309502 20678 raft_consensus.cc:3037] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.309623 20817 raft_consensus.cc:3037] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.311759 20678 raft_consensus.cc:2454] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 1.
I20260923 19:36:23.312239 20884 leader_election.cc:302] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, 7e456b2b00ef4664a8f0a714e7bfc74d; no voters:
I20260923 19:36:23.312570 21032 raft_consensus.cc:2781] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:23.312762 21032 raft_consensus.cc:686] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 LEADER]: Becoming Leader. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Running, Role: LEADER
I20260923 19:36:23.313047 21032 consensus_queue.cc:237] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.313295 20817 raft_consensus.cc:2454] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 1.
I20260923 19:36:23.315033 21056 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: TxnStatusTablet state changed. Reason: New leader 7e456b2b00ef4664a8f0a714e7bfc74d. Latest consensus state: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.315372 21056 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:36:23.316195 21068 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 19:36:23.316442 21068 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 19:36:23.316833 20516 catalog_manager.cc:5495] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195). New cstate: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } health_report { overall_health: HEALTHY } } }
I20260923 19:36:23.336678 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.330002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33895 (local address 127.0.0.1:46280)
0923 19:36:23.330254 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:23.330278 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:23.330429 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:23.331088 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:23.331093 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:23.331108 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:36:23.331289 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.331298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.332507 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.332513 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.333972 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.333993 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.334940 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.334946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.335112 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.335172 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:36:23.336072 (+ 900us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:36:23.336095 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:36:23.336210 (+ 115us) client_negotiation.cc:240] Negotiation successful
0923 19:36:23.336374 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:36:23.337210 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.330481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46280 (local address 127.12.159.195:33895)
0923 19:36:23.330696 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.330701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.330716 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:36:23.330807 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.330810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.330885 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.331056 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:23.331445 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.332358 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.334141 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.334761 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.334906 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.335399 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:23.335929 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:23.336098 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.336245 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.336340 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:36:23.341630 20678 raft_consensus.cc:1261] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Refusing update from remote peer 7e456b2b00ef4664a8f0a714e7bfc74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:23.341830 20817 raft_consensus.cc:1261] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Refusing update from remote peer 7e456b2b00ef4664a8f0a714e7bfc74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:23.342550 21032 consensus_queue.cc:1035] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:23.343233 21032 consensus_queue.cc:1035] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:23.358110 21033 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: TxnStatusTablet state changed. Reason: New leader 7e456b2b00ef4664a8f0a714e7bfc74d. Latest consensus state: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.358527 21033 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:36:23.358687 21031 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: TxnStatusTablet state changed. Reason: New leader 7e456b2b00ef4664a8f0a714e7bfc74d. Latest consensus state: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.359047 21031 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:36:23.361425 21056 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.361707 21056 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:36:23.365582 21039 mvcc.cc:205] Tried to move back new op lower bound from 7332627182958829568 to 7332627182853435392. Current Snapshot: MvccSnapshot[applied={T|T < 7332627182958829568}]
I20260923 19:36:23.367718 21033 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.367980 21033 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P edb5f7bec9b040158a74f5632d6c72e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:36:23.368532 21056 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.368882 21056 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P 7e456b2b00ef4664a8f0a714e7bfc74d: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:36:23.370554 21040 mvcc.cc:205] Tried to move back new op lower bound from 7332627182958829568 to 7332627182853435392. Current Snapshot: MvccSnapshot[applied={T|T < 7332627182958829568}]
I20260923 19:36:23.373144 21031 tablet_replica.cc:439] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } } }
I20260923 19:36:23.373479 21031 tablet_replica.cc:442] T 054d278cb831424b89a442c211b5c339 P 340284084eea4f3fb92101d5547313f0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:36:23.385398 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.380179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46282 (local address 127.12.159.195:33895)
0923 19:36:23.380357 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.380363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.380380 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:36:23.380433 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.380436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.380570 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.380698 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:23.381166 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.382062 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.383478 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.383988 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.384136 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.384640 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:23.384744 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:23.384860 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.385028 (+ 168us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.385114 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:36:23.403767 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.397278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:60509 (local address 127.12.159.195:33895)
0923 19:36:23.397476 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.397484 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.398233 (+ 749us) server_negotiation.cc:407] Connection header received
0923 19:36:23.398483 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.398488 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.398569 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.398666 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:23.399213 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.400108 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.401709 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.402293 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.402447 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.402902 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:23.403039 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:23.403140 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.403287 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.403358 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:36:23.403865 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.397340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33895 (local address 127.12.159.195:60509)
0923 19:36:23.398126 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:23.398144 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:23.398338 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:23.398690 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:23.398694 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:23.398706 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:36:23.399047 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.399057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.400254 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.400261 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.401543 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:23.401556 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.402508 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.402515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:23.402657 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.402712 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:36:23.403139 (+ 427us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:36:23.403151 (+ 12us) client_negotiation.cc:769] Sending connection context
0923 19:36:23.403269 (+ 118us) client_negotiation.cc:240] Negotiation successful
0923 19:36:23.403411 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":459,"threads_started":1}
I20260923 19:36:23.415683 20816 raft_consensus.cc:1261] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Refusing update from remote peer 7e456b2b00ef4664a8f0a714e7bfc74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:23.415657 20678 raft_consensus.cc:1261] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Refusing update from remote peer 7e456b2b00ef4664a8f0a714e7bfc74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:23.416294 21073 consensus_queue.cc:1035] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:23.416966 21056 consensus_queue.cc:1035] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:23.532994 20516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:23.533270 20516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:23.536375 20516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Sending DeleteTablet for 3 replicas of tablet 7896a6b33cbc4012b2d1237f08036077
I20260923 19:36:23.537271 20653 tablet_service.cc:1514] Processing DeleteTablet for tablet 7896a6b33cbc4012b2d1237f08036077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:23 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:59964
I20260923 19:36:23.537599 21051 tablet_replica.cc:330] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: stopping tablet replica
I20260923 19:36:23.537768 20792 tablet_service.cc:1514] Processing DeleteTablet for tablet 7896a6b33cbc4012b2d1237f08036077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:23 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:38736
I20260923 19:36:23.537832 21051 raft_consensus.cc:2229] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:23.538051 21051 raft_consensus.cc:2258] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.538092 21049 tablet_replica.cc:330] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: stopping tablet replica
I20260923 19:36:23.538281 21049 raft_consensus.cc:2229] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:23.538456 21049 raft_consensus.cc:2258] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.539279 20931 tablet_service.cc:1514] Processing DeleteTablet for tablet 7896a6b33cbc4012b2d1237f08036077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:23 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:46264
I20260923 19:36:23.539559 21051 ts_tablet_manager.cc:1905] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.540513 21049 ts_tablet_manager.cc:1905] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.547843 21049 ts_tablet_manager.cc:1918] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:36:23.548058 21049 log.cc:1196] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/7896a6b33cbc4012b2d1237f08036077
I20260923 19:36:23.548027 21051 ts_tablet_manager.cc:1918] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:36:23.548285 21051 log.cc:1196] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/7896a6b33cbc4012b2d1237f08036077
I20260923 19:36:23.548465 21049 ts_tablet_manager.cc:1939] T 7896a6b33cbc4012b2d1237f08036077 P edb5f7bec9b040158a74f5632d6c72e5: Deleting consensus metadata
I20260923 19:36:23.548960 21051 ts_tablet_manager.cc:1939] T 7896a6b33cbc4012b2d1237f08036077 P 340284084eea4f3fb92101d5547313f0: Deleting consensus metadata
I20260923 19:36:23.549667 20501 catalog_manager.cc:4841] TS edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505): tablet 7896a6b33cbc4012b2d1237f08036077 (table test-table [id=423d300ace044c95b85da63adc4b4870]) successfully deleted
I20260923 19:36:23.550217 20502 catalog_manager.cc:4841] TS 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353): tablet 7896a6b33cbc4012b2d1237f08036077 (table test-table [id=423d300ace044c95b85da63adc4b4870]) successfully deleted
I20260923 19:36:23.550592 21080 tablet_replica.cc:330] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: stopping tablet replica
I20260923 19:36:23.550830 21080 raft_consensus.cc:2229] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:36:23.551420 21080 raft_consensus.cc:2258] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.552737 21080 ts_tablet_manager.cc:1905] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.561442 21080 ts_tablet_manager.cc:1918] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:36:23.561748 21080 log.cc:1196] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/7896a6b33cbc4012b2d1237f08036077
I20260923 19:36:23.562268 21080 ts_tablet_manager.cc:1939] T 7896a6b33cbc4012b2d1237f08036077 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting consensus metadata
I20260923 19:36:23.563627 20502 catalog_manager.cc:4841] TS 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895): tablet 7896a6b33cbc4012b2d1237f08036077 (table test-table [id=423d300ace044c95b85da63adc4b4870]) successfully deleted
Sep 23 19:36:23 dist-test-slave-lzv7 krb5kdc[20471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:36:23 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:23 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:36:23.603885 20611 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:23.593180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58436 (local address 127.12.159.254:38147)
0923 19:36:23.593404 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.593414 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.593968 (+ 554us) server_negotiation.cc:407] Connection header received
0923 19:36:23.594270 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.594277 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.594363 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.594424 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:23.595950 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.596745 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.598199 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.598634 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.598778 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.603664 (+ 4886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58436: BlockingRecv error: recv got EOF from 127.0.0.1:58436 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Sep 23 19:36:23 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM
I20260923 19:36:23.622731 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.607427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58438 (local address 127.12.159.254:38147)
0923 19:36:23.607635 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.607641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.607957 (+ 316us) server_negotiation.cc:407] Connection header received
0923 19:36:23.608100 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.608106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.608200 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.608319 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:23.609535 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.610687 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.612005 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.612660 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.612787 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.617023 (+ 4236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:23.617029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:23.617034 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:23.617075 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:23.619928 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:23.620766 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:23.620771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:23.620773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:23.620894 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:23.621307 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:23.621311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:23.621313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:23.621600 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:23.621778 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.622169 (+ 391us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.622362 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260923 19:36:23.626430 20516 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:36:23.627072 20516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:23.634220 20792 tablet_service.cc:1467] Processing CreateTablet for tablet eab2d91788e84fe7ba54c0efc5ccaf08 (DEFAULT_TABLE table=test-table [id=f6a3c54526744475b30e89a76dd84209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:23.634563 20653 tablet_service.cc:1467] Processing CreateTablet for tablet eab2d91788e84fe7ba54c0efc5ccaf08 (DEFAULT_TABLE table=test-table [id=f6a3c54526744475b30e89a76dd84209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:23.634696 20792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eab2d91788e84fe7ba54c0efc5ccaf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.634990 20653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eab2d91788e84fe7ba54c0efc5ccaf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.641247 21027 tablet_bootstrap.cc:492] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: Bootstrap starting.
I20260923 19:36:23.642287 20931 tablet_service.cc:1467] Processing CreateTablet for tablet eab2d91788e84fe7ba54c0efc5ccaf08 (DEFAULT_TABLE table=test-table [id=f6a3c54526744475b30e89a76dd84209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:23.642732 20931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eab2d91788e84fe7ba54c0efc5ccaf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:23.642961 21027 tablet_bootstrap.cc:654] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.644964 21027 tablet_bootstrap.cc:492] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: No bootstrap required, opened a new log
I20260923 19:36:23.645089 21027 ts_tablet_manager.cc:1397] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:36:23.646028 21025 tablet_bootstrap.cc:492] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: Bootstrap starting.
I20260923 19:36:23.645869 21027 raft_consensus.cc:348] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.646121 21027 raft_consensus.cc:374] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.646209 21027 raft_consensus.cc:729] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb5f7bec9b040158a74f5632d6c72e5, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.646437 21027 consensus_queue.cc:260] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.646984 21027 ts_tablet_manager.cc:1428] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:36:23.647632 21025 tablet_bootstrap.cc:654] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.652824 21028 tablet_bootstrap.cc:492] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: Bootstrap starting.
I20260923 19:36:23.654541 21028 tablet_bootstrap.cc:654] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:23.656759 21028 tablet_bootstrap.cc:492] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: No bootstrap required, opened a new log
I20260923 19:36:23.657091 21028 ts_tablet_manager.cc:1397] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260923 19:36:23.658061 21025 tablet_bootstrap.cc:492] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: No bootstrap required, opened a new log
I20260923 19:36:23.658222 21025 ts_tablet_manager.cc:1397] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260923 19:36:23.658876 21028 raft_consensus.cc:348] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.658960 21025 raft_consensus.cc:348] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.659376 21025 raft_consensus.cc:374] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.659472 21025 raft_consensus.cc:729] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340284084eea4f3fb92101d5547313f0, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.659461 21028 raft_consensus.cc:374] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:23.659699 21028 raft_consensus.cc:729] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Initialized, Role: FOLLOWER
I20260923 19:36:23.659729 21025 consensus_queue.cc:260] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.660079 21028 consensus_queue.cc:260] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.660825 21028 ts_tablet_manager.cc:1428] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:36:23.662334 21025 ts_tablet_manager.cc:1428] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:36:23.897492 21033 raft_consensus.cc:482] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:23.897747 21033 raft_consensus.cc:504] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.898524 21033 leader_election.cc:288] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895)
I20260923 19:36:23.899241 20677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eab2d91788e84fe7ba54c0efc5ccaf08" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0" is_pre_election: true
I20260923 19:36:23.899240 20951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eab2d91788e84fe7ba54c0efc5ccaf08" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" is_pre_election: true
I20260923 19:36:23.899513 20951 raft_consensus.cc:2454] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 0.
I20260923 19:36:23.899514 20677 raft_consensus.cc:2454] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 0.
I20260923 19:36:23.899971 20745 leader_election.cc:302] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, edb5f7bec9b040158a74f5632d6c72e5; no voters:
I20260923 19:36:23.900255 21033 raft_consensus.cc:2781] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:23.900393 21033 raft_consensus.cc:482] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:23.900524 21033 raft_consensus.cc:3037] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.903029 21033 raft_consensus.cc:504] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.903964 21033 leader_election.cc:288] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 election: Requested vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895)
I20260923 19:36:23.904093 20677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eab2d91788e84fe7ba54c0efc5ccaf08" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0"
I20260923 19:36:23.904291 20677 raft_consensus.cc:3037] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.904526 20951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eab2d91788e84fe7ba54c0efc5ccaf08" candidate_uuid: "edb5f7bec9b040158a74f5632d6c72e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d"
I20260923 19:36:23.904846 20951 raft_consensus.cc:3037] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:23.907123 20951 raft_consensus.cc:2454] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 1.
I20260923 19:36:23.907234 20677 raft_consensus.cc:2454] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb5f7bec9b040158a74f5632d6c72e5 in term 1.
I20260923 19:36:23.907620 20745 leader_election.cc:302] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, edb5f7bec9b040158a74f5632d6c72e5; no voters:
I20260923 19:36:23.907919 21033 raft_consensus.cc:2781] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:23.908353 21033 raft_consensus.cc:686] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 LEADER]: Becoming Leader. State: Replica: edb5f7bec9b040158a74f5632d6c72e5, State: Running, Role: LEADER
I20260923 19:36:23.908677 21033 consensus_queue.cc:237] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:23.911578 20515 catalog_manager.cc:5495] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194). New cstate: current_term: 1 leader_uuid: "edb5f7bec9b040158a74f5632d6c72e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } health_report { overall_health: UNKNOWN } } }
I20260923 19:36:23.954823 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:23.947363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38754 (local address 127.12.159.194:37505)
0923 19:36:23.948047 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:23.948055 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:23.948076 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:36:23.948144 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:23.948150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:23.948235 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:23.948380 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:23.948842 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.949636 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.951847 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:23.952686 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:23.952845 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:23.953328 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:23.953524 (+ 196us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:23.954204 (+ 680us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:23.954278 (+ 74us) server_negotiation.cc:299] Negotiation successful
0923 19:36:23.954366 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":410,"threads_started":1}
I20260923 19:36:23.958150 20677 raft_consensus.cc:1261] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Refusing update from remote peer edb5f7bec9b040158a74f5632d6c72e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:23.958295 20951 raft_consensus.cc:1261] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Refusing update from remote peer edb5f7bec9b040158a74f5632d6c72e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:23.958797 21096 consensus_queue.cc:1035] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:23.959154 21033 consensus_queue.cc:1035] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:23.983898 20515 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:23.984200 20515 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:23.987579 20515 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Sending DeleteTablet for 3 replicas of tablet eab2d91788e84fe7ba54c0efc5ccaf08
I20260923 19:36:23.988484 20653 tablet_service.cc:1514] Processing DeleteTablet for tablet eab2d91788e84fe7ba54c0efc5ccaf08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:23 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:59964
I20260923 19:36:23.988824 20792 tablet_service.cc:1514] Processing DeleteTablet for tablet eab2d91788e84fe7ba54c0efc5ccaf08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:23 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:38736
I20260923 19:36:23.989130 21051 tablet_replica.cc:330] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: stopping tablet replica
I20260923 19:36:23.989319 21051 raft_consensus.cc:2229] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:23.989588 21051 raft_consensus.cc:2258] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.989909 21049 tablet_replica.cc:330] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: stopping tablet replica
I20260923 19:36:23.990085 21049 raft_consensus.cc:2229] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:36:23.990420 21049 raft_consensus.cc:2258] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.990703 21051 ts_tablet_manager.cc:1905] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.991263 20931 tablet_service.cc:1514] Processing DeleteTablet for tablet eab2d91788e84fe7ba54c0efc5ccaf08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:23 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:46264
I20260923 19:36:23.992159 21049 ts_tablet_manager.cc:1905] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.995390 21051 ts_tablet_manager.cc:1918] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:23.995565 21051 log.cc:1196] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/eab2d91788e84fe7ba54c0efc5ccaf08
I20260923 19:36:23.995774 21080 tablet_replica.cc:330] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: stopping tablet replica
I20260923 19:36:23.996023 21080 raft_consensus.cc:2229] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:23.996275 21051 ts_tablet_manager.cc:1939] T eab2d91788e84fe7ba54c0efc5ccaf08 P 340284084eea4f3fb92101d5547313f0: Deleting consensus metadata
I20260923 19:36:23.996310 21080 raft_consensus.cc:2258] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:23.997448 21080 ts_tablet_manager.cc:1905] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:23.997632 20502 catalog_manager.cc:4841] TS 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353): tablet eab2d91788e84fe7ba54c0efc5ccaf08 (table test-table [id=f6a3c54526744475b30e89a76dd84209]) successfully deleted
I20260923 19:36:23.998831 20515 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:36:23.999737 21049 ts_tablet_manager.cc:1918] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260923 19:36:23.999754 20515 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:23.999941 21049 log.cc:1196] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/eab2d91788e84fe7ba54c0efc5ccaf08
I20260923 19:36:24.000391 21049 ts_tablet_manager.cc:1939] T eab2d91788e84fe7ba54c0efc5ccaf08 P edb5f7bec9b040158a74f5632d6c72e5: Deleting consensus metadata
I20260923 19:36:24.001972 20501 catalog_manager.cc:4841] TS edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505): tablet eab2d91788e84fe7ba54c0efc5ccaf08 (table test-table [id=f6a3c54526744475b30e89a76dd84209]) successfully deleted
I20260923 19:36:24.004411 21080 ts_tablet_manager.cc:1918] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:24.004905 21080 log.cc:1196] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/eab2d91788e84fe7ba54c0efc5ccaf08
I20260923 19:36:24.005437 21080 ts_tablet_manager.cc:1939] T eab2d91788e84fe7ba54c0efc5ccaf08 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting consensus metadata
I20260923 19:36:24.006794 20502 catalog_manager.cc:4841] TS 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895): tablet eab2d91788e84fe7ba54c0efc5ccaf08 (table test-table [id=f6a3c54526744475b30e89a76dd84209]) successfully deleted
I20260923 19:36:24.007978 20653 tablet_service.cc:1467] Processing CreateTablet for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 (DEFAULT_TABLE table=test-table [id=35e39914d00047f1944737f51c6a1fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:24.008122 20792 tablet_service.cc:1467] Processing CreateTablet for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 (DEFAULT_TABLE table=test-table [id=35e39914d00047f1944737f51c6a1fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:24.008431 20653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:24.008560 20792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:24.012845 21025 tablet_bootstrap.cc:492] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: Bootstrap starting.
I20260923 19:36:24.014225 20931 tablet_service.cc:1467] Processing CreateTablet for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 (DEFAULT_TABLE table=test-table [id=35e39914d00047f1944737f51c6a1fc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:24.014490 21025 tablet_bootstrap.cc:654] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:24.014689 20931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:24.023240 21027 tablet_bootstrap.cc:492] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: Bootstrap starting.
I20260923 19:36:24.024072 21028 tablet_bootstrap.cc:492] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: Bootstrap starting.
I20260923 19:36:24.025003 21027 tablet_bootstrap.cc:654] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:24.026258 21028 tablet_bootstrap.cc:654] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:24.031736 21028 tablet_bootstrap.cc:492] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: No bootstrap required, opened a new log
I20260923 19:36:24.031924 21028 ts_tablet_manager.cc:1397] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260923 19:36:24.032837 21028 raft_consensus.cc:348] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.033211 21028 raft_consensus.cc:374] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:24.033316 21028 raft_consensus.cc:729] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Initialized, Role: FOLLOWER
I20260923 19:36:24.033679 21028 consensus_queue.cc:260] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.037408 21028 ts_tablet_manager.cc:1428] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:36:24.039589 21027 tablet_bootstrap.cc:492] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: No bootstrap required, opened a new log
I20260923 19:36:24.039829 21027 ts_tablet_manager.cc:1397] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.005s
I20260923 19:36:24.040635 21027 raft_consensus.cc:348] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.040961 21027 raft_consensus.cc:374] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:24.041072 21027 raft_consensus.cc:729] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb5f7bec9b040158a74f5632d6c72e5, State: Initialized, Role: FOLLOWER
I20260923 19:36:24.041462 21025 tablet_bootstrap.cc:492] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: No bootstrap required, opened a new log
I20260923 19:36:24.041384 21027 consensus_queue.cc:260] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.041702 21025 ts_tablet_manager.cc:1397] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.021s
I20260923 19:36:24.042433 21025 raft_consensus.cc:348] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.042706 21025 raft_consensus.cc:374] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:24.042806 21025 raft_consensus.cc:729] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340284084eea4f3fb92101d5547313f0, State: Initialized, Role: FOLLOWER
I20260923 19:36:24.043057 21025 consensus_queue.cc:260] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.043565 21025 ts_tablet_manager.cc:1428] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:36:24.046463 21027 ts_tablet_manager.cc:1428] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:36:24.191357 21073 raft_consensus.cc:482] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:24.191610 21073 raft_consensus.cc:504] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.192414 21073 leader_election.cc:288] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505)
I20260923 19:36:24.193027 20677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60fbcb93754fc1b0eb1fac4ad7e173" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0" is_pre_election: true
I20260923 19:36:24.193123 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60fbcb93754fc1b0eb1fac4ad7e173" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb5f7bec9b040158a74f5632d6c72e5" is_pre_election: true
I20260923 19:36:24.193286 20677 raft_consensus.cc:2454] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 0.
I20260923 19:36:24.193379 20817 raft_consensus.cc:2454] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 0.
I20260923 19:36:24.193866 20884 leader_election.cc:302] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340284084eea4f3fb92101d5547313f0, 7e456b2b00ef4664a8f0a714e7bfc74d; no voters:
I20260923 19:36:24.194409 21073 raft_consensus.cc:2781] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:24.194535 21073 raft_consensus.cc:482] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:24.194677 21073 raft_consensus.cc:3037] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:24.197974 21073 raft_consensus.cc:504] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.199142 20817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60fbcb93754fc1b0eb1fac4ad7e173" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb5f7bec9b040158a74f5632d6c72e5"
I20260923 19:36:24.199157 20677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60fbcb93754fc1b0eb1fac4ad7e173" candidate_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340284084eea4f3fb92101d5547313f0"
I20260923 19:36:24.199371 20677 raft_consensus.cc:3037] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:24.199380 20817 raft_consensus.cc:3037] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:24.202605 20817 raft_consensus.cc:2454] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 1.
I20260923 19:36:24.202618 20677 raft_consensus.cc:2454] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e456b2b00ef4664a8f0a714e7bfc74d in term 1.
I20260923 19:36:24.203090 20883 leader_election.cc:302] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e456b2b00ef4664a8f0a714e7bfc74d, edb5f7bec9b040158a74f5632d6c72e5; no voters:
I20260923 19:36:24.203682 21073 leader_election.cc:288] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [CANDIDATE]: Term 1 election: Requested vote from peers 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353), edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505)
I20260923 19:36:24.203958 21105 raft_consensus.cc:2781] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:24.204216 21105 raft_consensus.cc:686] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 LEADER]: Becoming Leader. State: Replica: 7e456b2b00ef4664a8f0a714e7bfc74d, State: Running, Role: LEADER
I20260923 19:36:24.204679 21105 consensus_queue.cc:237] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } }
I20260923 19:36:24.211928 20516 catalog_manager.cc:5495] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195). New cstate: current_term: 1 leader_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e456b2b00ef4664a8f0a714e7bfc74d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33895 } health_report { overall_health: HEALTHY } } }
I20260923 19:36:24.239301 21108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:24.233679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.12.159.195:33895)
0923 19:36:24.234346 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:24.234350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:24.234369 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:36:24.234418 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:24.234421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:24.234496 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:24.234619 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:24.235075 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.235916 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.237348 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.237863 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.238003 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:24.238458 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:24.238588 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:24.238689 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:24.238869 (+ 180us) server_negotiation.cc:299] Negotiation successful
0923 19:36:24.238946 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":366,"threads_started":1}
I20260923 19:36:24.249547 20817 raft_consensus.cc:1261] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Refusing update from remote peer 7e456b2b00ef4664a8f0a714e7bfc74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:24.249528 20677 raft_consensus.cc:1261] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Refusing update from remote peer 7e456b2b00ef4664a8f0a714e7bfc74d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:24.250097 21107 consensus_queue.cc:1035] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "340284084eea4f3fb92101d5547313f0" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:24.250468 21105 consensus_queue.cc:1035] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb5f7bec9b040158a74f5632d6c72e5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:24.305503 20516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:24.305845 20516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:24.309005 20516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36128e8aca024b1bb1e4b67b4cc74e1e: Sending DeleteTablet for 3 replicas of tablet 9d60fbcb93754fc1b0eb1fac4ad7e173
I20260923 19:36:24.309928 20653 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:24 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:59964
I20260923 19:36:24.310058 20930 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:24 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:46264
I20260923 19:36:24.310247 20792 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:24 UTC) from {username='oryx', principal='oryx/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:38736
I20260923 19:36:24.310428 21051 tablet_replica.cc:330] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: stopping tablet replica
I20260923 19:36:24.310556 21049 tablet_replica.cc:330] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: stopping tablet replica
I20260923 19:36:24.310600 21051 raft_consensus.cc:2229] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:24.310745 21051 raft_consensus.cc:2258] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:24.310748 21049 raft_consensus.cc:2229] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:24.310911 21049 raft_consensus.cc:2258] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:24.311009 21080 tablet_replica.cc:330] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: stopping tablet replica
I20260923 19:36:24.311223 21080 raft_consensus.cc:2229] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:36:24.311560 21080 raft_consensus.cc:2258] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:24.311872 21051 ts_tablet_manager.cc:1905] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:24.312687 21080 ts_tablet_manager.cc:1905] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:24.312845 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 20587
I20260923 19:36:24.319175 21080 ts_tablet_manager.cc:1918] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:36:24.319335 21080 log.cc:1196] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/9d60fbcb93754fc1b0eb1fac4ad7e173
I20260923 19:36:24.319782 21080 ts_tablet_manager.cc:1939] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 7e456b2b00ef4664a8f0a714e7bfc74d: Deleting consensus metadata
I20260923 19:36:24.320276 21051 ts_tablet_manager.cc:1918] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:36:24.320873 20502 catalog_manager.cc:4841] TS 7e456b2b00ef4664a8f0a714e7bfc74d (127.12.159.195:33895): tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 (table test-table [id=35e39914d00047f1944737f51c6a1fc6]) successfully deleted
I20260923 19:36:24.321723 21049 ts_tablet_manager.cc:1905] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:24.324506 21051 log.cc:1196] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/9d60fbcb93754fc1b0eb1fac4ad7e173
I20260923 19:36:24.324970 21051 ts_tablet_manager.cc:1939] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P 340284084eea4f3fb92101d5547313f0: Deleting consensus metadata
I20260923 19:36:24.326241 20502 catalog_manager.cc:4841] TS 340284084eea4f3fb92101d5547313f0 (127.12.159.193:38353): tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 (table test-table [id=35e39914d00047f1944737f51c6a1fc6]) successfully deleted
I20260923 19:36:24.326853 21049 ts_tablet_manager.cc:1918] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:36:24.327016 21049 log.cc:1196] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/9d60fbcb93754fc1b0eb1fac4ad7e173
I20260923 19:36:24.327405 21049 ts_tablet_manager.cc:1939] T 9d60fbcb93754fc1b0eb1fac4ad7e173 P edb5f7bec9b040158a74f5632d6c72e5: Deleting consensus metadata
I20260923 19:36:24.328552 20501 catalog_manager.cc:4841] TS edb5f7bec9b040158a74f5632d6c72e5 (127.12.159.194:37505): tablet 9d60fbcb93754fc1b0eb1fac4ad7e173 (table test-table [id=35e39914d00047f1944737f51c6a1fc6]) successfully deleted
Sep 23 19:36:24 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.193@KRBTEST.COM
I20260923 19:36:24.340816 21113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:24.314197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59980 (local address 127.12.159.193:38353)
0923 19:36:24.325780 (+ 11583us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:24.325786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:24.325828 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:36:24.325886 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:24.325890 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:24.325961 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:24.327708 (+ 1747us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:24.327886 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.328880 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.330206 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.330644 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.330740 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:24.335124 (+ 4384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:24.335139 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:24.335155 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:24.335192 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:24.338062 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:24.338776 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:24.338785 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:24.338787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:24.338914 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:24.339305 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:24.339315 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:24.339317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:24.339640 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:24.339935 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:24.340236 (+ 301us) server_negotiation.cc:299] Negotiation successful
0923 19:36:24.340459 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11428,"thread_start_us":11294,"threads_started":1}
I20260923 19:36:24.341682 20718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:24.441309 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 20587
I20260923 19:36:24.459132 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 20727
Sep 23 19:36:24 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.194@KRBTEST.COM
I20260923 19:36:24.475384 21116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:24.459898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38756 (local address 127.12.159.194:37505)
0923 19:36:24.460374 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:24.460378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:24.460394 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:36:24.460447 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:24.460451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:24.460509 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:24.460670 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:24.462014 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.462744 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.464060 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.464463 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.464559 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:24.468832 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:24.468847 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:24.468864 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:24.468899 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:24.472223 (+ 3324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:24.472933 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:24.472940 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:24.472943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:24.473085 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:24.473518 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:24.473525 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:24.473530 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:24.474100 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:24.474390 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:24.474700 (+ 310us) server_negotiation.cc:299] Negotiation successful
0923 19:36:24.474898 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":280,"threads_started":1}
I20260923 19:36:24.476286 20857 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:24.608157 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 20727
I20260923 19:36:24.630391 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 20866
Sep 23 19:36:24 dist-test-slave-lzv7 krb5kdc[20471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192183, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.159.195@KRBTEST.COM
I20260923 19:36:24.646065 21108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:24.631244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46300 (local address 127.12.159.195:33895)
0923 19:36:24.631436 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:24.631443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:24.631545 (+ 102us) server_negotiation.cc:407] Connection header received
0923 19:36:24.631829 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:24.631834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:24.631898 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:24.632005 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:24.633301 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.634083 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.635378 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:24.635794 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:24.635939 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:24.640447 (+ 4508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:24.640461 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:24.640478 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:24.640514 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:24.643271 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:24.643942 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:24.643949 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:24.643951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:24.644073 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:24.644440 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:24.644446 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:24.644449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:24.644793 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:24.645093 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:24.645373 (+ 280us) server_negotiation.cc:299] Negotiation successful
0923 19:36:24.645615 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:36:24.646778 20996 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:24.798252 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 20866
I20260923 19:36:24.823413 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 20484
I20260923 19:36:24.824640 20556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:24.942046 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 20484
2026-09-23T19:36:24Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (5689 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:36:25 dist-test-slave-lzv7 krb5kdc[21123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:36:25 dist-test-slave-lzv7 krb5kdc[21123](info): set up 2 sockets
Sep 23 19:36:25 dist-test-slave-lzv7 krb5kdc[21123](info): commencing operation
krb5kdc: starting...
W20260923 19:36:26.138949 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.002s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:36:26 dist-test-slave-lzv7 krb5kdc[21123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:36:26.366195 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38739
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:33291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:38739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:26.695528 21136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:26.695883 21136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:26.696058 21136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:26.704123 21136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:26.704263 21136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:26.704346 21136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:26.704432 21136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:26.704509 21136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:26.714565 21136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:33291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:38739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:38739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:26.715914 21136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:26.717221 21136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:26.729094 21141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:26.729107 21144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:26.729064 21142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:26.730206 21136 server_base.cc:1034] running on GCE node
I20260923 19:36:26.731101 21136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:26.732914 21136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:26.734177 21136 hybrid_clock.cc:648] HybridClock initialized: now 1790192186734181 us; error 112 us; skew 500 ppm
I20260923 19:36:26.734570 21136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-23T19:36:26Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1861 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:36:26 dist-test-slave-lzv7 krb5kdc[21150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:36:26 dist-test-slave-lzv7 krb5kdc[21150](info): set up 2 sockets
Sep 23 19:36:26 dist-test-slave-lzv7 krb5kdc[21150](info): commencing operation
krb5kdc: starting...
W20260923 19:36:27.930928 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.004s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:36:28 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:36:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:36:28.163710 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41237
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:41237
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:28.495918 21163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:28.496210 21163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:28.496368 21163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:28.503691 21163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:28.503859 21163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:28.503976 21163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:28.504084 21163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:28.504161 21163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:28.515136 21163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:41237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:28.516592 21163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:28.518016 21163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:28.537281 21171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:28.537336 21169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:28.538658 21168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:28.538957 21163 server_base.cc:1034] running on GCE node
I20260923 19:36:28.540001 21163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:28.541703 21163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:28.543036 21163 hybrid_clock.cc:648] HybridClock initialized: now 1790192188542918 us; error 135 us; skew 500 ppm
I20260923 19:36:28.543524 21163 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:28 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192188, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:28.547646 21163 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:36:28.550333 21163 webserver.cc:460] Webserver started at http://127.12.159.254:39111/ using document root <none> and password file <none>
I20260923 19:36:28.551334 21163 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:28.551522 21163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:28.551923 21163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:28.556210 21163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "4f28f84c121a4c8c906c3688a83b8eb5"
format_stamp: "Formatted at 2026-09-23 19:36:28 on dist-test-slave-lzv7"
server_key: "1cf28c272c7ef3b5ffb655d31d8b0da3"
server_key_iv: "e867127ed9d467aa87d3086681754868"
server_key_version: "encryptionkey@0"
I20260923 19:36:28.557052 21163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "4f28f84c121a4c8c906c3688a83b8eb5"
format_stamp: "Formatted at 2026-09-23 19:36:28 on dist-test-slave-lzv7"
server_key: "1cf28c272c7ef3b5ffb655d31d8b0da3"
server_key_iv: "e867127ed9d467aa87d3086681754868"
server_key_version: "encryptionkey@0"
I20260923 19:36:28.562542 21163 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260923 19:36:28.566103 21178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:28.567538 21163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:36:28.567737 21163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "4f28f84c121a4c8c906c3688a83b8eb5"
format_stamp: "Formatted at 2026-09-23 19:36:28 on dist-test-slave-lzv7"
server_key: "1cf28c272c7ef3b5ffb655d31d8b0da3"
server_key_iv: "e867127ed9d467aa87d3086681754868"
server_key_version: "encryptionkey@0"
I20260923 19:36:28.567940 21163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:28.583562 21163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:28.588052 21163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:28.588362 21163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:28.607546 21163 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:41237
I20260923 19:36:28.607575 21229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:41237 every 8 connection(s)
I20260923 19:36:28.608989 21163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:28.612840 21230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:28.616223 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 21163
I20260923 19:36:28.616436 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:28.617259 12927 external_mini_cluster.cc:1428] Setting key 36d8a60d0654d99fd59c7ff937a12789
I20260923 19:36:28.625554 21230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Bootstrap starting.
I20260923 19:36:28.628687 21230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:28.629707 21230 log.cc:824] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:36:28 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:28.632565 21230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: No bootstrap required, opened a new log
I20260923 19:36:28.639745 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:28.619573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43472 (local address 127.12.159.254:41237)
0923 19:36:28.620378 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:28.620391 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:28.620432 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:36:28.622238 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:28.622261 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:28.622696 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:28.623113 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:28.624637 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:28.626088 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:28.627322 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:28.627996 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:28.628186 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:28.632267 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:28.632274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:28.632288 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:28.632322 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:28.635506 (+ 3184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:28.636225 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:28.636232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:28.636238 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:28.636411 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:28.636796 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:28.636808 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:28.636810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:28.637345 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:28.637683 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:28.638214 (+ 531us) server_negotiation.cc:299] Negotiation successful
0923 19:36:28.638658 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":391,"threads_started":1}
I20260923 19:36:28.640539 21230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:28.640888 21230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:28.641029 21230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f28f84c121a4c8c906c3688a83b8eb5, State: Initialized, Role: FOLLOWER
I20260923 19:36:28.641595 21230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:28.641871 21230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:28.642046 21230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:28.642230 21230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:28.644675 21230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:28.645160 21230 leader_election.cc:302] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f28f84c121a4c8c906c3688a83b8eb5; no voters:
I20260923 19:36:28.645720 21230 leader_election.cc:288] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:28.645874 21235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:28.646607 21235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f28f84c121a4c8c906c3688a83b8eb5, State: Running, Role: LEADER
I20260923 19:36:28.647141 21235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:28.647838 21230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:28.650301 21237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f28f84c121a4c8c906c3688a83b8eb5. Latest consensus state: current_term: 1 leader_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } } }
I20260923 19:36:28.650682 21237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:28.651331 21236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } } }
I20260923 19:36:28.651976 21236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:28.652881 21243 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:28.659189 21243 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:28.668658 21243 catalog_manager.cc:1347] Generated new cluster ID: 64f275aaf5774a74851d45c16ad87430
I20260923 19:36:28.668792 21243 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:28.700829 21243 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:28.702885 21243 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:28.709652 21243 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Generated new TSK 0
I20260923 19:36:28.710728 21243 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:36:28.769443 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41237
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:29.103075 21256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:29.103361 21256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:29.103526 21256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:29.110765 21256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:29.110891 21256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:29.111086 21256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:29.121232 21256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:29.122646 21256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:29.123992 21256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:29.137380 21262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:29.137494 21264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:29.137516 21261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:29.138901 21256 server_base.cc:1034] running on GCE node
I20260923 19:36:29.139577 21256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:29.140633 21256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:29.141930 21256 hybrid_clock.cc:648] HybridClock initialized: now 1790192189141857 us; error 34 us; skew 500 ppm
I20260923 19:36:29.142228 21256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:29 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192189, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:29.145396 21256 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:36:29.146842 21256 webserver.cc:460] Webserver started at http://127.12.159.193:39509/ using document root <none> and password file <none>
I20260923 19:36:29.147640 21256 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:29.147779 21256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:29.148087 21256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:29.151244 21256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "74122fa9bf3c405cb5abcc1855a692d8"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "d14eea5ec613ed8c332209e433e1ab96"
server_key_iv: "a8ed578b39352436ec8e1e93af210aea"
server_key_version: "encryptionkey@0"
I20260923 19:36:29.152081 21256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "74122fa9bf3c405cb5abcc1855a692d8"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "d14eea5ec613ed8c332209e433e1ab96"
server_key_iv: "a8ed578b39352436ec8e1e93af210aea"
server_key_version: "encryptionkey@0"
I20260923 19:36:29.157577 21256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:36:29.161263 21271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:29.162739 21256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:29.162899 21256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "74122fa9bf3c405cb5abcc1855a692d8"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "d14eea5ec613ed8c332209e433e1ab96"
server_key_iv: "a8ed578b39352436ec8e1e93af210aea"
server_key_version: "encryptionkey@0"
I20260923 19:36:29.163122 21256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:29.188481 21256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:29.193176 21256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:29.193476 21256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:29.194522 21256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:29.195889 21256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:29.195962 21256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:29.196096 21256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:29.196161 21256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:29.230480 21256 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:38227
I20260923 19:36:29.230583 21383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:38227 every 8 connection(s)
I20260923 19:36:29.231837 21256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:29.242117 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 21256
I20260923 19:36:29.242363 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:36:29.243336 12927 external_mini_cluster.cc:1428] Setting key fb64c074ec39c7a6190823ce19cb81bc
Sep 23 19:36:29 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192189, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:29.255266 21386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:29.234455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:45879 (local address 127.12.159.254:41237)
0923 19:36:29.234897 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:29.234902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:29.235940 (+ 1038us) server_negotiation.cc:407] Connection header received
0923 19:36:29.237977 (+ 2037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:29.237982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:29.238060 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:29.238160 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:29.239765 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.240569 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.242404 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.243091 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.243257 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:29.247274 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:29.247284 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:29.247293 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:29.247344 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:29.251370 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:29.252438 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:29.252447 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:29.252453 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:29.252638 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:29.253157 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:29.253165 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:29.253171 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:29.253600 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:29.253732 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:29.254831 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0923 19:36:29.255007 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":216,"threads_started":1}
I20260923 19:36:29.256992 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:29.234991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:45879)
0923 19:36:29.235768 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:29.235807 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:29.237609 (+ 1802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:29.238391 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:29.238400 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:29.238962 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:29.239590 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:29.239609 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.240720 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.240725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:29.242211 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:29.242224 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.243330 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.243335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:29.243620 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:29.244364 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:29.244410 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:29.247020 (+ 2610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:29.251551 (+ 4531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:29.251564 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:29.251584 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:29.252268 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:29.252763 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:29.252770 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:29.252777 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:29.253012 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:29.253757 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:29.253768 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:29.254317 (+ 549us) client_negotiation.cc:769] Sending connection context
0923 19:36:29.254670 (+ 353us) client_negotiation.cc:240] Negotiation successful
0923 19:36:29.255350 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":287,"threads_started":1}
I20260923 19:36:29.258893 21384 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41237
I20260923 19:36:29.259227 21384 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:29.259953 21384 heartbeater.cc:511] Master 127.12.159.254:41237 requested a full tablet report, sending...
I20260923 19:36:29.262491 21195 ts_manager.cc:194] Registered new tserver with Master: 74122fa9bf3c405cb5abcc1855a692d8 (127.12.159.193:38227)
I20260923 19:36:29.264990 21195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:45879
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:36:29.301996 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41237
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:29.627359 21390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:29.627710 21390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:29.627887 21390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:29.635115 21390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:29.635281 21390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:29.635475 21390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:29.645437 21390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:29.646826 21390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:29.648350 21390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:29.661993 21398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:29.662010 21396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:29.662199 21395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:29.662694 21390 server_base.cc:1034] running on GCE node
I20260923 19:36:29.663254 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:29.664134 21390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:29.665357 21390 hybrid_clock.cc:648] HybridClock initialized: now 1790192189665289 us; error 62 us; skew 500 ppm
I20260923 19:36:29.665699 21390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:29 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192189, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:29.669095 21390 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:36:29.670756 21390 webserver.cc:460] Webserver started at http://127.12.159.194:42275/ using document root <none> and password file <none>
I20260923 19:36:29.671545 21390 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:29.671691 21390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:29.672025 21390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:29.675122 21390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "f833bf4e166341708b95c3ef980a8386"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "2d6e38c2769ed2f0df577864ee4031be"
server_key_iv: "64c4b06dba7fd6f14ea563f889bfd386"
server_key_version: "encryptionkey@0"
I20260923 19:36:29.676141 21390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "f833bf4e166341708b95c3ef980a8386"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "2d6e38c2769ed2f0df577864ee4031be"
server_key_iv: "64c4b06dba7fd6f14ea563f889bfd386"
server_key_version: "encryptionkey@0"
I20260923 19:36:29.681589 21390 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260923 19:36:29.685256 21405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:29.686677 21390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:29.686856 21390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "f833bf4e166341708b95c3ef980a8386"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "2d6e38c2769ed2f0df577864ee4031be"
server_key_iv: "64c4b06dba7fd6f14ea563f889bfd386"
server_key_version: "encryptionkey@0"
I20260923 19:36:29.687065 21390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:29.722790 21390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:29.727094 21390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:29.727396 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:29.728398 21390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:29.729754 21390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:29.729878 21390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260923 19:36:29.730031 21390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:29.730103 21390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:29.764451 21390 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:34083
I20260923 19:36:29.764511 21517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:34083 every 8 connection(s)
I20260923 19:36:29.765852 21390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:29.774263 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 21390
I20260923 19:36:29.774435 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:36:29.774879 12927 external_mini_cluster.cc:1428] Setting key 074412e85cb4f8daf57d524ec46a1b94
Sep 23 19:36:29 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192189, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:29.787581 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:29.768481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:41827 (local address 127.12.159.254:41237)
0923 19:36:29.768957 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:29.768961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:29.769774 (+ 813us) server_negotiation.cc:407] Connection header received
0923 19:36:29.771734 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:29.771740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:29.771835 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:29.771956 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:29.773554 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.774396 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.776171 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.776753 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.776884 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:29.780629 (+ 3745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:29.780638 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:29.780646 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:29.780693 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:29.784170 (+ 3477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:29.785172 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:29.785176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:29.785179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:29.785309 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:29.785777 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:29.785785 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:29.785789 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:29.786124 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:29.786294 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:29.786970 (+ 676us) server_negotiation.cc:299] Negotiation successful
0923 19:36:29.787193 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":254,"threads_started":1}
I20260923 19:36:29.788626 21521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:29.768926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:41827)
0923 19:36:29.769610 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:29.769654 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:29.771458 (+ 1804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:29.772236 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:29.772244 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:29.772839 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:29.773383 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:29.773400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.774585 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.774589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:29.776029 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:29.776041 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:29.776986 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:29.776993 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:29.777221 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:29.777942 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:29.777970 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:29.780367 (+ 2397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:29.784331 (+ 3964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:29.784344 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:29.784364 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:29.785052 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:29.785448 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:29.785453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:29.785457 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:29.785657 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:29.786264 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:29.786272 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:29.786621 (+ 349us) client_negotiation.cc:769] Sending connection context
0923 19:36:29.786894 (+ 273us) client_negotiation.cc:240] Negotiation successful
0923 19:36:29.787450 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":264,"threads_started":1}
I20260923 19:36:29.790233 21518 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41237
I20260923 19:36:29.790573 21518 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:29.791393 21518 heartbeater.cc:511] Master 127.12.159.254:41237 requested a full tablet report, sending...
I20260923 19:36:29.792975 21195 ts_manager.cc:194] Registered new tserver with Master: f833bf4e166341708b95c3ef980a8386 (127.12.159.194:34083)
I20260923 19:36:29.793895 21195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:41827
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:36:29.828630 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41237
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:30.160061 21524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:30.160344 21524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:30.160501 21524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:30.167835 21524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:30.167946 21524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:30.168107 21524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:30.178113 21524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:30.179535 21524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:30.180842 21524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:30.194625 21530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:30.194653 21529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:30.194558 21532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:30.196056 21524 server_base.cc:1034] running on GCE node
I20260923 19:36:30.196733 21524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:30.197752 21524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:30.199015 21524 hybrid_clock.cc:648] HybridClock initialized: now 1790192190198978 us; error 32 us; skew 500 ppm
I20260923 19:36:30.199417 21524 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:30 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:30.202787 21524 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:36:30.204385 21524 webserver.cc:460] Webserver started at http://127.12.159.195:36399/ using document root <none> and password file <none>
I20260923 19:36:30.205096 21524 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:30.205247 21524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:30.205559 21524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:30.208724 21524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "336dcab67d1348ad853ce3de506ee5bb"
format_stamp: "Formatted at 2026-09-23 19:36:30 on dist-test-slave-lzv7"
server_key: "d33aa16231681348c5324cf67c2099de"
server_key_iv: "2c484aaa99ddb9a79c366acc424184e6"
server_key_version: "encryptionkey@0"
I20260923 19:36:30.209539 21524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "336dcab67d1348ad853ce3de506ee5bb"
format_stamp: "Formatted at 2026-09-23 19:36:30 on dist-test-slave-lzv7"
server_key: "d33aa16231681348c5324cf67c2099de"
server_key_iv: "2c484aaa99ddb9a79c366acc424184e6"
server_key_version: "encryptionkey@0"
I20260923 19:36:30.215055 21524 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:36:30.219069 21539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:30.220585 21524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:36:30.220777 21524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "336dcab67d1348ad853ce3de506ee5bb"
format_stamp: "Formatted at 2026-09-23 19:36:30 on dist-test-slave-lzv7"
server_key: "d33aa16231681348c5324cf67c2099de"
server_key_iv: "2c484aaa99ddb9a79c366acc424184e6"
server_key_version: "encryptionkey@0"
I20260923 19:36:30.220994 21524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:30.250125 21524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:30.254640 21524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:30.254940 21524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:30.255911 21524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:30.257318 21524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:30.257421 21524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:30.257558 21524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:30.257633 21524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:30.268687 21384 heartbeater.cc:503] Master 127.12.159.254:41237 was elected leader, sending a full tablet report...
I20260923 19:36:30.292239 21524 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:36281
I20260923 19:36:30.292393 21651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:36281 every 8 connection(s)
I20260923 19:36:30.293534 21524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:30.301666 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 21524
I20260923 19:36:30.301896 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:36:30.302512 12927 external_mini_cluster.cc:1428] Setting key f9108b481b423962ef1866dc560ab3f4
Sep 23 19:36:30 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:30.315030 21654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:30.296336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:49705 (local address 127.12.159.254:41237)
0923 19:36:30.296797 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:30.296804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:30.297847 (+ 1043us) server_negotiation.cc:407] Connection header received
0923 19:36:30.299717 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:30.299722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:30.299796 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:30.299912 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:30.301530 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.302937 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.305054 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.305625 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.305781 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:30.309315 (+ 3534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:30.309321 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:30.309324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:30.309356 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:30.312002 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.312705 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.312711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.312717 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.312839 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.313249 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.313257 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.313262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.313519 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:30.313696 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:30.314429 (+ 733us) server_negotiation.cc:299] Negotiation successful
0923 19:36:30.314642 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":210,"threads_started":1}
I20260923 19:36:30.316042 21655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:30.296893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:49705)
0923 19:36:30.297644 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:30.297689 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:30.299407 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:30.300158 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:30.300167 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:30.300682 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:30.301316 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:30.301334 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.303159 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.303166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:30.304904 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:30.304918 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.305920 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.305926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:30.306129 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:30.306777 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:30.306799 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:30.309072 (+ 2273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:30.312142 (+ 3070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:30.312151 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:30.312168 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:30.312578 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:30.312950 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:30.312955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:30.312958 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:30.313138 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:30.313653 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:30.313661 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:30.314066 (+ 405us) client_negotiation.cc:769] Sending connection context
0923 19:36:30.314326 (+ 260us) client_negotiation.cc:240] Negotiation successful
0923 19:36:30.314857 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":321,"threads_started":1}
I20260923 19:36:30.317559 21652 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41237
I20260923 19:36:30.317970 21652 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:30.318696 21652 heartbeater.cc:511] Master 127.12.159.254:41237 requested a full tablet report, sending...
I20260923 19:36:30.320056 21194 ts_manager.cc:194] Registered new tserver with Master: 336dcab67d1348ad853ce3de506ee5bb (127.12.159.195:36281)
I20260923 19:36:30.320968 21194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:49705
I20260923 19:36:30.330797 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab.
Entry for principal oryx/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab.
WARNING: no policy specified for oryx/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab.
Entry for principal oryx/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab.
WARNING: no policy specified for oryx/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab.
Entry for principal oryx/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab.
I20260923 19:36:30.474526 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21256
Sep 23 19:36:30 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:36:30.491865 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:30.475646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42348 (local address 127.12.159.193:38227)
0923 19:36:30.476290 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:30.476298 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:30.476326 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:36:30.476387 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:30.476394 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:30.476607 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:30.476779 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:30.478398 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.479520 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.480846 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.481472 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.481577 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:30.486120 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:30.486135 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:30.486197 (+ 62us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:30.486235 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:30.489196 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.489925 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.489933 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.489935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.490057 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.490397 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.490400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.490402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.490814 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:30.491034 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:30.491317 (+ 283us) server_negotiation.cc:299] Negotiation successful
0923 19:36:30.491508 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":300,"threads_started":1}
I20260923 19:36:30.493124 21379 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:30.583741 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 21256
I20260923 19:36:30.600387 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21390
Sep 23 19:36:30 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:36:30.618093 21665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:30.601382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38532 (local address 127.12.159.194:34083)
0923 19:36:30.601990 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:30.601997 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:30.602023 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:36:30.602084 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:30.602090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:30.602295 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:30.602427 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:30.603652 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.604670 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.606152 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.606729 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.606872 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:30.611501 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:30.611513 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:30.611529 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:30.611568 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:30.614781 (+ 3213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.615638 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.615648 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.615651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.615794 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.616224 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.616230 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.616234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.616608 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:30.616958 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:30.617319 (+ 361us) server_negotiation.cc:299] Negotiation successful
0923 19:36:30.617625 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":321,"threads_started":1}
I20260923 19:36:30.619464 21513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:30.704296 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 21390
I20260923 19:36:30.720497 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21524
Sep 23 19:36:30 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:36:30.737994 21667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:30.721585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59742 (local address 127.12.159.195:36281)
0923 19:36:30.722275 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:30.722282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:30.722318 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:36:30.722409 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:30.722416 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:30.722662 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:30.722822 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:30.724348 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.725473 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.726949 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:30.727546 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:30.727656 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:30.732111 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:30.732122 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:30.732138 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:30.732171 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:30.735068 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.735800 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.735807 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.735809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.735923 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:30.736293 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:30.736299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:30.736303 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:30.736652 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:30.736955 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:30.737280 (+ 325us) server_negotiation.cc:299] Negotiation successful
0923 19:36:30.737542 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":354,"threads_started":1}
I20260923 19:36:30.739355 21647 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:30.825911 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 21524
I20260923 19:36:30.842324 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21163
I20260923 19:36:30.843636 21225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:30.950001 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 21163
I20260923 19:36:30.971118 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41237
--webserver_interface=127.12.159.254
--webserver_port=39111
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:41237
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:31.303675 21670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:31.304051 21670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:31.304231 21670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:31.311533 21670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:31.311688 21670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:31.311797 21670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:31.311902 21670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:31.311987 21670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:31.321904 21670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:41237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=39111
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:31.323295 21670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:31.324679 21670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:31.337311 21678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:31.337276 21676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:31.337265 21675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:31.338016 21670 server_base.cc:1034] running on GCE node
I20260923 19:36:31.338986 21670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:31.340456 21670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:31.341686 21670 hybrid_clock.cc:648] HybridClock initialized: now 1790192191341623 us; error 40 us; skew 500 ppm
I20260923 19:36:31.342101 21670 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192191, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:31.345678 21670 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:36:31.347440 21670 webserver.cc:460] Webserver started at http://127.12.159.254:39111/ using document root <none> and password file <none>
I20260923 19:36:31.348177 21670 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:31.348335 21670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:31.354223 21670 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260923 19:36:31.357316 21685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:31.358933 21670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:31.359119 21670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "4f28f84c121a4c8c906c3688a83b8eb5"
format_stamp: "Formatted at 2026-09-23 19:36:28 on dist-test-slave-lzv7"
server_key: "1cf28c272c7ef3b5ffb655d31d8b0da3"
server_key_iv: "e867127ed9d467aa87d3086681754868"
server_key_version: "encryptionkey@0"
I20260923 19:36:31.360118 21670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:31.374397 21670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:31.378443 21670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:31.378716 21670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:31.397502 21670 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:41237
I20260923 19:36:31.397528 21736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:41237 every 8 connection(s)
I20260923 19:36:31.399184 21670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:31.403121 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 21670
I20260923 19:36:31.404006 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:38227
--local_ip_for_outbound_sockets=127.12.159.193
--tserver_master_addrs=127.12.159.254:41237
--webserver_port=39509
--webserver_interface=127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:36:31.406163 21737 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:36:31.409337 21737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Bootstrap starting.
I20260923 19:36:31.428313 21737 log.cc:824] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:31.437178 21737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:36:31.437728 21737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Bootstrap complete.
I20260923 19:36:31.446878 21737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:31.447767 21737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f28f84c121a4c8c906c3688a83b8eb5, State: Initialized, Role: FOLLOWER
I20260923 19:36:31.448496 21737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:31.448729 21737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:31.448840 21737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:31.449034 21737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:36:31.452821 21737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:31.453343 21737 leader_election.cc:302] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f28f84c121a4c8c906c3688a83b8eb5; no voters:
I20260923 19:36:31.454011 21737 leader_election.cc:288] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:36:31.454144 21741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:36:31.455262 21741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [term 2 LEADER]: Becoming Leader. State: Replica: 4f28f84c121a4c8c906c3688a83b8eb5, State: Running, Role: LEADER
I20260923 19:36:31.455854 21741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } }
I20260923 19:36:31.456240 21737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:31.458272 21743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f28f84c121a4c8c906c3688a83b8eb5. Latest consensus state: current_term: 2 leader_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } } }
I20260923 19:36:31.458655 21743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:31.459163 21742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f28f84c121a4c8c906c3688a83b8eb5" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41237 } } }
I20260923 19:36:31.459456 21742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:31.469790 21747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:31.477006 21747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:31.479074 21747 catalog_manager.cc:1259] Loaded cluster ID: 64f275aaf5774a74851d45c16ad87430
I20260923 19:36:31.479207 21747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:31.484570 21747 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:31.486675 21747 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4f28f84c121a4c8c906c3688a83b8eb5: Loaded TSK: 0
I20260923 19:36:31.488950 21747 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 19:36:31.770895 21739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:31.771193 21739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:31.771359 21739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:31.779145 21739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:31.779273 21739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:31.779446 21739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:31.790710 21739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.193.keytab
--principal=oryx/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:38227
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=39509
--tserver_master_addrs=127.12.159.254:41237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:31.792096 21739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:31.793556 21739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:31.813980 21763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:31.810079 21764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:31.814754 21766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:31.816154 21739 server_base.cc:1034] running on GCE node
I20260923 19:36:31.817042 21739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:31.819016 21739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:31.820302 21739 hybrid_clock.cc:648] HybridClock initialized: now 1790192191820211 us; error 66 us; skew 500 ppm
I20260923 19:36:31.820698 21739 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192191, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:31.824769 21739 init.cc:377] Logged in from keytab as oryx/127.12.159.193@KRBTEST.COM (short username oryx)
I20260923 19:36:31.826627 21739 webserver.cc:460] Webserver started at http://127.12.159.193:39509/ using document root <none> and password file <none>
I20260923 19:36:31.827370 21739 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:31.827517 21739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:31.833523 21739 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 19:36:31.836753 21773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:31.838415 21739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:31.838609 21739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "74122fa9bf3c405cb5abcc1855a692d8"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "d14eea5ec613ed8c332209e433e1ab96"
server_key_iv: "a8ed578b39352436ec8e1e93af210aea"
server_key_version: "encryptionkey@0"
I20260923 19:36:31.839625 21739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:31.860241 21739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:31.865016 21739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:31.865293 21739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:31.866668 21739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:31.868111 21739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:31.868235 21739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:31.868357 21739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:31.868451 21739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:31.903903 21739 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:38227
I20260923 19:36:31.903990 21885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:38227 every 8 connection(s)
I20260923 19:36:31.905357 21739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:31.907197 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 21739
I20260923 19:36:31.908011 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:34083
--local_ip_for_outbound_sockets=127.12.159.194
--tserver_master_addrs=127.12.159.254:41237
--webserver_port=42275
--webserver_interface=127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:31.928295 21888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:31.908681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:42645)
0923 19:36:31.909569 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:31.909627 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:31.911320 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:31.915574 (+ 4254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:31.915588 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:31.916348 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:31.916890 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:31.916906 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.919453 (+ 2547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.919459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:31.920842 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:31.920854 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.922374 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.922380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:31.922576 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:31.923284 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:31.923307 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:31.927227 (+ 3920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":340,"threads_started":1}
W20260923 19:36:31.929070 21886 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:41237 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.159.254:41237: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
W20260923 19:36:31.929064 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:31.908729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:42645 (local address 127.12.159.254:41237)
0923 19:36:31.914324 (+ 5595us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:31.914338 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:31.914380 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:36:31.914686 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:31.914699 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:31.915043 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:31.915351 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:31.917113 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.919243 (+ 2130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.920996 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.922133 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.922345 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:31.927748 (+ 5403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:42645: BlockingRecv error: recv got EOF from 127.12.159.193:42645 (error 108)
Metrics: {"server-negotiator.queue_time_us":5320,"thread_start_us":5123,"threads_started":1}
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:31.937796 21888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:31.930060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:55017)
0923 19:36:31.930242 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:31.930258 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:31.930378 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:31.930688 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:31.930692 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:31.931028 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:31.931160 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:31.931167 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.932392 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.932397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:31.933267 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:31.933278 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.933993 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.933998 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:31.934168 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:31.934734 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:31.934751 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:31.937499 (+ 2748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260923 19:36:31.937943 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:31.930233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:55017 (local address 127.12.159.254:41237)
0923 19:36:31.930405 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:31.930413 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:31.930433 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:36:31.930486 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:31.930491 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:31.930561 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:31.930661 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:31.931304 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.932235 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.933410 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.933798 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.933984 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:31.937691 (+ 3707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:55017: BlockingRecv error: recv got EOF from 127.12.159.193:55017 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:31 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:31.946002 21888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:31.938589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:48601)
0923 19:36:31.938742 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:31.938770 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:31.938862 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:31.939178 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:31.939182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:31.939474 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:31.939606 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:31.939614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.940596 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.940601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:31.941489 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:31.941499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.942261 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.942267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:31.942451 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:31.942999 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:31.943015 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:31.945730 (+ 2715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 19:36:31.946221 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:31.938674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:48601 (local address 127.12.159.254:41237)
0923 19:36:31.938846 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:31.938851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:31.938868 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:36:31.938977 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:31.938981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:31.939059 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:31.939156 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:31.939737 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.940462 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.941623 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:31.942113 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:31.942241 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:31.945987 (+ 3746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:48601: BlockingRecv error: recv got EOF from 127.12.159.193:48601 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 19:36:31.946365 21886 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 19:36:32.242671 21890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:32.242976 21890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:32.243151 21890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:32.250607 21890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:32.250718 21890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:32.250905 21890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:32.260910 21890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.194.keytab
--principal=oryx/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:34083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=42275
--tserver_master_addrs=127.12.159.254:41237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:32.262303 21890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:32.263665 21890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:32.277141 21895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:32.277385 21896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:32.277655 21898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:32.278110 21890 server_base.cc:1034] running on GCE node
I20260923 19:36:32.278751 21890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:32.279844 21890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:32.281088 21890 hybrid_clock.cc:648] HybridClock initialized: now 1790192192281029 us; error 54 us; skew 500 ppm
I20260923 19:36:32.281450 21890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192192, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:32.284771 21890 init.cc:377] Logged in from keytab as oryx/127.12.159.194@KRBTEST.COM (short username oryx)
I20260923 19:36:32.286533 21890 webserver.cc:460] Webserver started at http://127.12.159.194:42275/ using document root <none> and password file <none>
I20260923 19:36:32.287288 21890 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:32.287477 21890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:32.293408 21890 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260923 19:36:32.296445 21905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:32.297912 21890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:36:32.298101 21890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "f833bf4e166341708b95c3ef980a8386"
format_stamp: "Formatted at 2026-09-23 19:36:29 on dist-test-slave-lzv7"
server_key: "2d6e38c2769ed2f0df577864ee4031be"
server_key_iv: "64c4b06dba7fd6f14ea563f889bfd386"
server_key_version: "encryptionkey@0"
I20260923 19:36:32.299088 21890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:32.324194 21890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:32.328245 21890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:32.328579 21890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:32.329654 21890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:32.331162 21890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:32.331293 21890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:32.331429 21890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:32.331518 21890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:32.365213 21890 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:34083
I20260923 19:36:32.365314 22017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:34083 every 8 connection(s)
I20260923 19:36:32.366780 21890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:32.374969 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 21890
I20260923 19:36:32.375589 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:36281
--local_ip_for_outbound_sockets=127.12.159.195
--tserver_master_addrs=127.12.159.254:41237
--webserver_port=36399
--webserver_interface=127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:36:32.385401 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:32.369415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:50071 (local address 127.12.159.254:41237)
0923 19:36:32.369621 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.369627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.371013 (+ 1386us) server_negotiation.cc:407] Connection header received
0923 19:36:32.372967 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.372971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.373043 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.373136 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.374987 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.375928 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.378561 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.379005 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.379122 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.385056 (+ 5934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:50071: BlockingRecv error: recv got EOF from 127.12.159.194:50071 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:36:32.385885 22020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.370112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:50071)
0923 19:36:32.370850 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:32.370892 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:32.372676 (+ 1784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:32.373383 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:32.373391 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:32.374022 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:32.374761 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.374793 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.376091 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.376099 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.378366 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.378383 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.379252 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.379261 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.379603 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.380373 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:32.380418 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:32.384745 (+ 4327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":323,"threads_started":1}
W20260923 19:36:32.386648 22018 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:41237 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.159.254:41237: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:36:32.395222 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:32.387392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:41963 (local address 127.12.159.254:41237)
0923 19:36:32.387575 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.387582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.387602 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:36:32.387656 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.387661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.387727 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.387822 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.388448 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.389136 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.390324 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.390743 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.390873 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.395022 (+ 4149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:41963: BlockingRecv error: recv got EOF from 127.12.159.194:41963 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:36:32.395228 22020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.387224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:41963)
0923 19:36:32.387388 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:32.387414 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:32.387543 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:32.387845 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:32.387850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:32.388187 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:32.388313 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.388321 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.389261 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.389266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.390191 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.390201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.390882 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.390887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.391052 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.391619 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:32.391635 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:32.394861 (+ 3226us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:32.409417 22020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.396150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:59085)
0923 19:36:32.396315 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:32.396336 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:32.396445 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:32.400187 (+ 3742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:32.400192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:32.400614 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:32.400882 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.400895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.402395 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.402401 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.403905 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.403922 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.404857 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.404862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.405029 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.405694 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:32.405716 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:32.409130 (+ 3414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:36:32.409610 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:32.396275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:59085 (local address 127.12.159.254:41237)
0923 19:36:32.396459 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.396464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.396482 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:36:32.396536 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.396541 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.396604 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.400158 (+ 3554us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.401056 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.402250 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.404045 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.404700 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.404832 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.409377 (+ 4545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:59085: BlockingRecv error: recv got EOF from 127.12.159.194:59085 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 19:36:32.409976 22018 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 19:36:32.720261 22021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:32.720561 22021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:32.720657 22021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:32.728559 22021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:32.728679 22021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:32.728793 22021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:32.739319 22021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/krb5kdc/oryx_127.12.159.195.keytab
--principal=oryx/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:36281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=36399
--tserver_master_addrs=127.12.159.254:41237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:32.740581 22021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:32.741853 22021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:32.755369 22027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:32.755437 22029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:32.755460 22026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:32.759552 22021 server_base.cc:1034] running on GCE node
I20260923 19:36:32.760154 22021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:32.761077 22021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:32.762312 22021 hybrid_clock.cc:648] HybridClock initialized: now 1790192192762252 us; error 49 us; skew 500 ppm
I20260923 19:36:32.762701 22021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192192, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:32.766119 22021 init.cc:377] Logged in from keytab as oryx/127.12.159.195@KRBTEST.COM (short username oryx)
I20260923 19:36:32.767699 22021 webserver.cc:460] Webserver started at http://127.12.159.195:36399/ using document root <none> and password file <none>
I20260923 19:36:32.768391 22021 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:32.768507 22021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:32.774283 22021 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 19:36:32.777060 22036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:32.778544 22021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:32.778697 22021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "336dcab67d1348ad853ce3de506ee5bb"
format_stamp: "Formatted at 2026-09-23 19:36:30 on dist-test-slave-lzv7"
server_key: "d33aa16231681348c5324cf67c2099de"
server_key_iv: "2c484aaa99ddb9a79c366acc424184e6"
server_key_version: "encryptionkey@0"
I20260923 19:36:32.779688 22021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:32.797461 22021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:32.802223 22021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:32.802510 22021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:32.803530 22021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:32.804930 22021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:32.805047 22021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:32.805186 22021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:32.805274 22021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:32.848475 22021 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:36281
I20260923 19:36:32.848560 22148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:36281 every 8 connection(s)
I20260923 19:36:32.849980 22021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:32.851457 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22021
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:36:32.869719 22152 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:32.852613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:54889 (local address 127.12.159.254:41237)
0923 19:36:32.853370 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.853378 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.854331 (+ 953us) server_negotiation.cc:407] Connection header received
0923 19:36:32.856646 (+ 2315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.856651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.856726 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.856803 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.858795 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.859929 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.862614 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.863334 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.863464 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.869404 (+ 5940us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:54889: BlockingRecv error: recv got EOF from 127.12.159.195:54889 (error 108)
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":538,"threads_started":1}
I20260923 19:36:32.870435 21889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.852494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43484 (local address 127.12.159.254:41237)
0923 19:36:32.852866 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.852871 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.853256 (+ 385us) server_negotiation.cc:407] Connection header received
0923 19:36:32.853482 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.853487 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.853601 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.853728 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.855735 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.856487 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.858435 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.859077 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.859223 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.862629 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:32.862640 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:32.862666 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:32.862720 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:32.866727 (+ 4007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:32.867480 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:32.867491 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:32.867501 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:32.867709 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:32.868111 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:32.868116 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:32.868120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:32.868757 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:32.869060 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:32.869518 (+ 458us) server_negotiation.cc:299] Negotiation successful
0923 19:36:32.870049 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":243}
I20260923 19:36:32.870484 22153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.853237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:54889)
0923 19:36:32.854153 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:32.854204 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:32.856351 (+ 2147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:32.857095 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:32.857106 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:32.857848 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:32.858612 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.858631 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.860144 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.860149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.862452 (+ 2303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.862468 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.863573 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.863586 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.863938 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.864594 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:32.864630 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:32.869131 (+ 4501us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":319,"threads_started":1}
W20260923 19:36:32.871403 22149 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:41237 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.159.254:41237: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:32.880173 22153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.872013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:55473)
0923 19:36:32.872189 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:32.872210 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:32.872310 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:32.872895 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:32.872899 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:32.873320 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:32.873472 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.873480 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.874776 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.874781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.875683 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.875694 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.876379 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.876385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.876568 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.877087 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:32.877103 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:32.879971 (+ 2868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 19:36:32.880522 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:32.872466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:55473 (local address 127.12.159.254:41237)
0923 19:36:32.872634 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.872638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.872650 (+ 12us) server_negotiation.cc:407] Connection header received
0923 19:36:32.872686 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.872689 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.872757 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.872868 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.873606 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.874644 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.875823 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.876229 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.876362 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.880232 (+ 3870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:55473: BlockingRecv error: recv got EOF from 127.12.159.195:55473 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:32.889035 22153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.880899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:32893)
0923 19:36:32.881060 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:32.881075 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:32.881202 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:32.881532 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:32.881537 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:32.881934 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:32.882078 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.882086 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.883065 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.883072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.884180 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.884193 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.885047 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.885051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.885254 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.885920 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:32.885946 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:32.888829 (+ 2883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:36:32.889222 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:32.880990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:32893 (local address 127.12.159.254:41237)
0923 19:36:32.881253 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.881261 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.881279 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:36:32.881331 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.881335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.881400 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.881506 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.882216 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.882931 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.884325 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.884891 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.885008 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.889005 (+ 3997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:32893: BlockingRecv error: recv got EOF from 127.12.159.195:32893 (error 108)
Metrics: {"server-negotiator.queue_time_us":156}
W20260923 19:36:32.889344 22149 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:32 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:32.956303 22154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:32.947121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:52811)
0923 19:36:32.947865 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:32.947881 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:32.948013 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:32.948562 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:32.948567 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:32.949153 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:32.949406 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.949424 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.950514 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.950520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.951525 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:32.951537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.952298 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.952304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:32.952482 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.953114 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:32.953131 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:32.955954 (+ 2823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":466,"threads_started":1}
W20260923 19:36:32.956422 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:32.947221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:52811 (local address 127.12.159.254:41237)
0923 19:36:32.947437 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:32.947443 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:32.947990 (+ 547us) server_negotiation.cc:407] Connection header received
0923 19:36:32.948176 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:32.948181 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:32.948292 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:32.948418 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:32.949574 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.950368 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.951672 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:32.952112 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:32.952252 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:32.956175 (+ 3923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:52811: BlockingRecv error: recv got EOF from 127.12.159.193:52811 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Sep 23 19:36:33 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:33 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:33.419350 22155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:33.410574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:37431)
0923 19:36:33.411040 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:33.411056 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:33.411174 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:33.411511 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:33.411514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:33.411950 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:33.412137 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:33.412146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.413107 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.413111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:33.414089 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:33.414100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.414848 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.414855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:33.415028 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:33.415707 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:33.415725 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:33.419114 (+ 3389us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":256,"threads_started":1}
W20260923 19:36:33.419577 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:33.410714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:37431 (local address 127.12.159.254:41237)
0923 19:36:33.410967 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:33.410973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:33.411133 (+ 160us) server_negotiation.cc:407] Connection header received
0923 19:36:33.411273 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:33.411276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:33.411338 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:33.411420 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:33.412263 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.412972 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.414213 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.414639 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.414740 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:33.419312 (+ 4572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:37431: BlockingRecv error: recv got EOF from 127.12.159.194:37431 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Sep 23 19:36:33 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:33 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:33.906747 22156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:33.889988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:38869)
0923 19:36:33.890531 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:33.890547 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:33.890663 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:33.891016 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:33.891020 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:33.891453 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:33.891638 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:33.891645 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.892689 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.892693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:33.893706 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:33.893718 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.894782 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.894807 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:33.895002 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:33.902977 (+ 7975us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:33.903007 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:33.906443 (+ 3436us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":304,"threads_started":1}
W20260923 19:36:33.907156 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:33.890173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:38869 (local address 127.12.159.254:41237)
0923 19:36:33.890347 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:33.890353 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:33.890625 (+ 272us) server_negotiation.cc:407] Connection header received
0923 19:36:33.890810 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:33.890815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:33.890879 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:33.890966 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:33.891771 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.892559 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.893919 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.894597 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.894720 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:33.906890 (+ 12170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:38869: BlockingRecv error: recv got EOF from 127.12.159.195:38869 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Sep 23 19:36:33 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:33 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:33.965566 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:33.957342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:34975)
0923 19:36:33.957917 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:33.957933 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:33.958042 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:33.958341 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:33.958344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:33.958765 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:33.958930 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:33.958941 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.959981 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.959985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:33.960918 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:33.960929 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.961580 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.961584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:33.961692 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:33.962324 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:33.962341 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:33.965198 (+ 2857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":320,"threads_started":1}
W20260923 19:36:33.965694 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:33.957401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:34975 (local address 127.12.159.254:41237)
0923 19:36:33.957627 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:33.957634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:33.958007 (+ 373us) server_negotiation.cc:407] Connection header received
0923 19:36:33.958151 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:33.958155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:33.958219 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:33.958302 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:33.959058 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.959849 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.961046 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:33.961449 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:33.961538 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:33.965437 (+ 3899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:34975: BlockingRecv error: recv got EOF from 127.12.159.193:34975 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Sep 23 19:36:34 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:34 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:34.429212 22158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:34.420415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:51487)
0923 19:36:34.421028 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:34.421049 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:34.421206 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:34.421702 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:34.421708 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:34.422280 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:34.422476 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:34.422485 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.423447 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.423451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:34.424382 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:34.424394 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.425086 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.425091 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:34.425203 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:34.425933 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:34.425950 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:34.428948 (+ 2998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":322,"threads_started":1}
W20260923 19:36:34.429438 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:34.420522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:51487 (local address 127.12.159.254:41237)
0923 19:36:34.420762 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:34.420771 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:34.421142 (+ 371us) server_negotiation.cc:407] Connection header received
0923 19:36:34.421336 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:34.421342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:34.421526 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:34.421632 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:34.422614 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.423310 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.424537 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.424949 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.425051 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:34.429199 (+ 4148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:51487: BlockingRecv error: recv got EOF from 127.12.159.194:51487 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Sep 23 19:36:34 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:34 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:34.916846 22159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:34.907782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:40841)
0923 19:36:34.908407 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:34.908425 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:34.908572 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:34.908915 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:34.908920 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:34.909333 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:34.909509 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:34.909519 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.910644 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.910648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:34.911723 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:34.911737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.912710 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.912717 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:34.912902 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:34.913608 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:34.913629 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:34.916589 (+ 2960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":350,"threads_started":1}
W20260923 19:36:34.917128 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:34.907943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:40841 (local address 127.12.159.254:41237)
0923 19:36:34.908105 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:34.908109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:34.908511 (+ 402us) server_negotiation.cc:407] Connection header received
0923 19:36:34.908707 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:34.908711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:34.908772 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:34.908855 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:34.909655 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.910467 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.911918 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.912520 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.912667 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:34.916826 (+ 4159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:40841: BlockingRecv error: recv got EOF from 127.12.159.195:40841 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 23 19:36:34 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:34 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:34.976197 22160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:34.966592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:34779)
0923 19:36:34.967046 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:34.967062 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:34.967180 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:34.967546 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:34.967549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:34.967869 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:34.968052 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:34.968061 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.969069 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.969074 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:34.970060 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:34.970072 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.970986 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.970991 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:34.971138 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:34.971919 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:34.971946 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:34.975763 (+ 3817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":251,"threads_started":1}
W20260923 19:36:34.976238 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:34.966659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:34779 (local address 127.12.159.254:41237)
0923 19:36:34.966901 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:34.966908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:34.967168 (+ 260us) server_negotiation.cc:407] Connection header received
0923 19:36:34.967292 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:34.967296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:34.967358 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:34.967439 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:34.968190 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.968940 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.970192 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:34.970817 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:34.970915 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:34.975969 (+ 5054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:34779: BlockingRecv error: recv got EOF from 127.12.159.193:34779 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Sep 23 19:36:35 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:35 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:35.439570 22161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:35.430444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:49189)
0923 19:36:35.431033 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:35.431051 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:35.431212 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:35.431694 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:35.431700 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:35.432108 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:35.432379 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:35.432392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.433510 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.433514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:35.434702 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:35.434715 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.435376 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.435380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:35.435578 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:35.436201 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:35.436221 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:35.439207 (+ 2986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":355,"threads_started":1}
W20260923 19:36:35.439640 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:35.430540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:49189 (local address 127.12.159.254:41237)
0923 19:36:35.430753 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:35.430760 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:35.431139 (+ 379us) server_negotiation.cc:407] Connection header received
0923 19:36:35.431388 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:35.431393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:35.431474 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:35.431601 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:35.432541 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.433355 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.434828 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.435227 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.435318 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:35.439402 (+ 4084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:49189: BlockingRecv error: recv got EOF from 127.12.159.194:49189 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 23 19:36:35 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:35 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:35.926559 22162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:35.917908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:36035)
0923 19:36:35.918477 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:35.918496 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:35.918621 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:35.919014 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:35.919018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:35.919354 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:35.919539 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:35.919548 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.920574 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.920579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:35.921552 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:35.921566 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.922400 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.922406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:35.922605 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:35.923256 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:35.923274 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:35.926179 (+ 2905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":321,"threads_started":1}
W20260923 19:36:35.926640 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:35.918053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:36035 (local address 127.12.159.254:41237)
0923 19:36:35.918226 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:35.918230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:35.918573 (+ 343us) server_negotiation.cc:407] Connection header received
0923 19:36:35.918776 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:35.918781 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:35.918848 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:35.918946 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:35.919678 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.920437 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.921716 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.922257 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.922386 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:35.926399 (+ 4013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:36035: BlockingRecv error: recv got EOF from 127.12.159.195:36035 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Sep 23 19:36:35 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:35 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:35.985715 22163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:35.977183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:56229)
0923 19:36:35.977679 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:35.977695 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:35.977870 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:35.978203 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:35.978207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:35.978626 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:35.978771 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:35.978780 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.979779 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.979786 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:35.980787 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:35.980798 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.981489 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.981493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:35.981624 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:35.982294 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:35.982312 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:35.985436 (+ 3124us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":260,"threads_started":1}
W20260923 19:36:35.986018 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:35.977266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56229 (local address 127.12.159.254:41237)
0923 19:36:35.977506 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:35.977519 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:35.977777 (+ 258us) server_negotiation.cc:407] Connection header received
0923 19:36:35.978005 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:35.978009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:35.978074 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:35.978171 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:35.978914 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.979653 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.980926 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:35.981321 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:35.981461 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:35.985695 (+ 4234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:56229: BlockingRecv error: recv got EOF from 127.12.159.193:56229 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Sep 23 19:36:36 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:36 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:36.449429 22164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:36.440685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:38989)
0923 19:36:36.441166 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:36.441201 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:36.441359 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:36.441687 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:36.441692 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:36.442134 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:36.442292 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:36.442301 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.443343 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.443349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:36.444341 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:36.444352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.445199 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.445205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:36.445377 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:36.446027 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:36.446044 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:36.449200 (+ 3156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":255,"threads_started":1}
W20260923 19:36:36.449626 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:36.440780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:38989 (local address 127.12.159.254:41237)
0923 19:36:36.441025 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:36.441033 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:36.441289 (+ 256us) server_negotiation.cc:407] Connection header received
0923 19:36:36.441484 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:36.441489 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:36.441561 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:36.441660 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:36.442430 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.443213 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.444483 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.445056 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.445179 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:36.449387 (+ 4208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:38989: BlockingRecv error: recv got EOF from 127.12.159.194:38989 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Sep 23 19:36:36 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:36 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:36.935717 22165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:36.927579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:33745)
0923 19:36:36.928133 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:36.928154 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:36.928265 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:36.928550 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:36.928553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:36.928897 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:36.929036 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:36.929044 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.930045 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.930049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:36.931029 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:36.931040 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.931724 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.931729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:36.931865 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:36.932530 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:36.932549 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:36.935501 (+ 2952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":335,"threads_started":1}
W20260923 19:36:36.935992 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:36.927683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:33745 (local address 127.12.159.254:41237)
0923 19:36:36.927869 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:36.927874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:36.928230 (+ 356us) server_negotiation.cc:407] Connection header received
0923 19:36:36.928359 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:36.928362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:36.928424 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:36.928510 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:36.929191 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.929911 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.931163 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.931573 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.931679 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:36.935710 (+ 4031us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:33745: BlockingRecv error: recv got EOF from 127.12.159.195:33745 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Sep 23 19:36:36 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:36 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:36.995235 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:36.986698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:56127)
0923 19:36:36.987216 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:36.987232 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:36.987343 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:36.987679 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:36.987682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:36.988138 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:36.988310 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:36.988320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.989374 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.989378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:36.990307 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:36.990317 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.990971 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.990975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:36.991097 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:36.991738 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:36.991756 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:36.994993 (+ 3237us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":260,"threads_started":1}
W20260923 19:36:36.995452 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:36.986783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56127 (local address 127.12.159.254:41237)
0923 19:36:36.986971 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:36.986975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:36.987326 (+ 351us) server_negotiation.cc:407] Connection header received
0923 19:36:36.987477 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:36.987481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:36.987545 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:36.987648 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:36.988512 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.989220 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.990435 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:36.990847 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:36.990944 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:36.995238 (+ 4294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:56127: BlockingRecv error: recv got EOF from 127.12.159.193:56127 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Sep 23 19:36:37 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:37 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:37.459422 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:37.450640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:48511)
0923 19:36:37.451266 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:37.451282 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:37.451444 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:37.451778 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:37.451793 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:37.452199 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:37.452350 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:37.452360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.453435 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.453440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:37.454424 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:37.454436 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.455113 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.455119 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:37.455294 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:37.455918 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:37.455935 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:37.459057 (+ 3122us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":365,"threads_started":1}
W20260923 19:36:37.459566 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:37.450927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:48511 (local address 127.12.159.254:41237)
0923 19:36:37.451160 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:37.451167 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:37.451372 (+ 205us) server_negotiation.cc:407] Connection header received
0923 19:36:37.451560 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:37.451566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:37.451646 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:37.451746 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:37.452522 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.453295 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.454558 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.454970 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.455101 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:37.459287 (+ 4186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:48511: BlockingRecv error: recv got EOF from 127.12.159.194:48511 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Sep 23 19:36:37 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:37 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:37.945996 22168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:37.936690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:41741)
0923 19:36:37.937306 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:37.937331 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:37.937476 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:37.937866 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:37.937872 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:37.938377 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:37.938559 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:37.938569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.939629 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.939635 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:37.940609 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:37.940621 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.941531 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.941537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:37.941725 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:37.942408 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:37.942428 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:37.945684 (+ 3256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":297,"threads_started":1}
W20260923 19:36:37.946290 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:37.936798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:41741 (local address 127.12.159.254:41237)
0923 19:36:37.937015 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:37.937023 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:37.937403 (+ 380us) server_negotiation.cc:407] Connection header received
0923 19:36:37.937613 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:37.937619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:37.937698 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:37.937846 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:37.938723 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.939477 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.940890 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.941379 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.941526 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:37.945984 (+ 4458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:41741: BlockingRecv error: recv got EOF from 127.12.159.195:41741 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Sep 23 19:36:38 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:38 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:38.004838 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:37.996362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:59853)
0923 19:36:37.997151 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:37.997168 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:37.997336 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:37.997684 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:37.997690 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:37.998227 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:37.998450 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:37.998463 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.999497 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:37.999501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:38.000396 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:38.000406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.001083 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.001088 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:38.001205 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:38.001757 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:38.001783 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:38.004621 (+ 2838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":523,"threads_started":1}
W20260923 19:36:38.005134 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:37.996517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:59853 (local address 127.12.159.254:41237)
0923 19:36:37.996752 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:37.996760 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:37.997292 (+ 532us) server_negotiation.cc:407] Connection header received
0923 19:36:37.997465 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:37.997474 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:37.997538 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:37.997615 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:37.998585 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:37.999380 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.000514 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.000949 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.001039 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:38.004845 (+ 3806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:59853: BlockingRecv error: recv got EOF from 127.12.159.193:59853 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Sep 23 19:36:38 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:38 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:38.469583 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:38.460500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:55833)
0923 19:36:38.461061 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:38.461079 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:38.461262 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:38.461626 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:38.461633 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:38.462113 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:38.462366 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:38.462380 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.463700 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.463704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:38.464681 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:38.464692 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.465526 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.465531 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:38.465676 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:38.466479 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:38.466498 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:38.469353 (+ 2855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":298,"threads_started":1}
W20260923 19:36:38.469764 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:38.460696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:55833 (local address 127.12.159.254:41237)
0923 19:36:38.460978 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:38.460984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:38.461177 (+ 193us) server_negotiation.cc:407] Connection header received
0923 19:36:38.461392 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:38.461395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:38.461478 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:38.461561 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:38.462511 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.463503 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.464816 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.465365 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.465469 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:38.469547 (+ 4078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:55833: BlockingRecv error: recv got EOF from 127.12.159.194:55833 (error 108)
Metrics: {"server-negotiator.queue_time_us":151}
Sep 23 19:36:38 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:38 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:38.960878 22171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:38.946878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:40527)
0923 19:36:38.947454 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:38.947471 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:38.947585 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:38.947888 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:38.947891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:38.948257 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:38.948394 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:38.948402 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.949874 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.949880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:38.950853 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:38.950864 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.951574 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.951578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:38.951692 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:38.957467 (+ 5775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:38.957487 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:38.960552 (+ 3065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":309,"threads_started":1}
W20260923 19:36:38.961149 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:38.947038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:40527 (local address 127.12.159.254:41237)
0923 19:36:38.947233 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:38.947250 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:38.947549 (+ 299us) server_negotiation.cc:407] Connection header received
0923 19:36:38.947683 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:38.947687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:38.947750 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:38.947847 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:38.948563 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.949693 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.950984 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:38.951444 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:38.951539 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:38.960854 (+ 9315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:40527: BlockingRecv error: recv got EOF from 127.12.159.195:40527 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Sep 23 19:36:39 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:39 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:39.014108 22172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:39.005658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:55839)
0923 19:36:39.006266 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:39.006283 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:39.006397 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:39.006683 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:39.006686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:39.007112 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:39.007270 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:39.007279 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.008220 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.008224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:39.009179 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:39.009189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.010132 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.010140 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:39.010336 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:39.010986 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:39.011005 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:39.013778 (+ 2773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":305,"threads_started":1}
W20260923 19:36:39.014241 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:39.005768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:55839 (local address 127.12.159.254:41237)
0923 19:36:39.005976 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:39.005981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:39.006355 (+ 374us) server_negotiation.cc:407] Connection header received
0923 19:36:39.006496 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:39.006500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:39.006563 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:39.006648 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:39.007389 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.008098 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.009299 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.009933 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.010077 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:39.014030 (+ 3953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:55839: BlockingRecv error: recv got EOF from 127.12.159.193:55839 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Sep 23 19:36:39 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:39 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:39.478965 22173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:39.470761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:50693)
0923 19:36:39.471369 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:39.471385 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:39.471500 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:39.471934 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:39.471937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:39.472322 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:39.472512 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:39.472520 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.473599 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.473603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:39.474521 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:39.474532 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.475243 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.475249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:39.475366 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:39.475929 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:39.475944 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:39.478710 (+ 2766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":269,"threads_started":1}
W20260923 19:36:39.479242 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:39.470796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:50693 (local address 127.12.159.254:41237)
0923 19:36:39.470999 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:39.471005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:39.471484 (+ 479us) server_negotiation.cc:407] Connection header received
0923 19:36:39.471646 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:39.471652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:39.471786 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:39.471897 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:39.472653 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.473470 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.474667 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.475106 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.475210 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:39.478973 (+ 3763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:50693: BlockingRecv error: recv got EOF from 127.12.159.194:50693 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Sep 23 19:36:39 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:39 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:39.971168 22174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:39.961965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:59675)
0923 19:36:39.962572 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:39.962591 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:39.962713 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:39.963095 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:39.963099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:39.963655 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:39.963865 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:39.963880 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.965042 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.965046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:39.966066 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:39.966078 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.966844 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.966851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:39.966975 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:39.967573 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:39.967592 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:39.970762 (+ 3170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":292,"threads_started":1}
W20260923 19:36:39.971283 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:39.961946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:59675 (local address 127.12.159.254:41237)
0923 19:36:39.962131 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:39.962135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:39.962678 (+ 543us) server_negotiation.cc:407] Connection header received
0923 19:36:39.962853 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:39.962857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:39.962920 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:39.963005 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:39.964060 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.964885 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.966213 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:39.966678 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:39.966794 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:39.971015 (+ 4221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:59675: BlockingRecv error: recv got EOF from 127.12.159.195:59675 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Sep 23 19:36:40 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:40 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:40.023620 22175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:40.015077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:33397)
0923 19:36:40.015628 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:40.015644 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:40.015762 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:40.016061 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:40.016064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:40.016427 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:40.016578 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:40.016585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.017791 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.017795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:40.018847 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:40.018868 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.019724 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.019731 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:40.019898 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:40.020656 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:40.020674 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:40.023381 (+ 2707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":253,"threads_started":1}
W20260923 19:36:40.023769 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:40.015315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:33397 (local address 127.12.159.254:41237)
0923 19:36:40.015590 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:40.015598 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:40.015751 (+ 153us) server_negotiation.cc:407] Connection header received
0923 19:36:40.015866 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:40.015870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:40.015936 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:40.016034 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:40.016712 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.017629 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.019020 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.019542 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.019638 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:40.023562 (+ 3924us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:33397: BlockingRecv error: recv got EOF from 127.12.159.193:33397 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
Sep 23 19:36:40 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:40 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:40.488538 22176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:40.479962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:43889)
0923 19:36:40.480490 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:40.480507 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:40.480618 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:40.480955 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:40.480959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:40.481299 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:40.481453 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:40.481461 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.482696 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.482700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:40.483793 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:40.483805 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.484661 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.484666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:40.484780 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:40.485469 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:40.485487 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:40.488304 (+ 2817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":284,"threads_started":1}
W20260923 19:36:40.488813 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:40.480039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:43889 (local address 127.12.159.254:41237)
0923 19:36:40.480197 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:40.480201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:40.480575 (+ 374us) server_negotiation.cc:407] Connection header received
0923 19:36:40.480708 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:40.480711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:40.480805 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:40.480884 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:40.481602 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.482539 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.483946 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.484484 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.484580 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:40.488527 (+ 3947us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:43889: BlockingRecv error: recv got EOF from 127.12.159.194:43889 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 23 19:36:40 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:40 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:40.980515 22177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:40.972221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:51727)
0923 19:36:40.972790 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:40.972807 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:40.972919 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:40.973307 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:40.973311 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:40.973693 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:40.973935 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:40.973947 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.975084 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.975088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:40.975999 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:40.976010 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.976723 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.976727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:40.976835 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:40.977528 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:40.977547 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:40.980277 (+ 2730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":310,"threads_started":1}
W20260923 19:36:40.980790 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:40.972295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:51727 (local address 127.12.159.254:41237)
0923 19:36:40.972497 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:40.972501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:40.972875 (+ 374us) server_negotiation.cc:407] Connection header received
0923 19:36:40.973067 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:40.973071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:40.973141 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:40.973243 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:40.974095 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.974932 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.976143 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:40.976570 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:40.976667 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:40.980499 (+ 3832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:51727: BlockingRecv error: recv got EOF from 127.12.159.195:51727 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Sep 23 19:36:41 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:41 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:41.033056 22178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:41.024592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:37751)
0923 19:36:41.025168 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:41.025184 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:41.025344 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:41.025671 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:41.025675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:41.026098 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:41.026255 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:41.026263 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.027257 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.027264 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:41.028260 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:41.028271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.028980 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.028986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:41.029167 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:41.029781 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:41.029798 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:41.032822 (+ 3024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":308,"threads_started":1}
W20260923 19:36:41.033247 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:41.024676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:37751 (local address 127.12.159.254:41237)
0923 19:36:41.024916 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:41.024925 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:41.025272 (+ 347us) server_negotiation.cc:407] Connection header received
0923 19:36:41.025465 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:41.025475 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:41.025540 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:41.025640 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:41.026397 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.027123 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.028396 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.028820 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.028955 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:41.033012 (+ 4057us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:37751: BlockingRecv error: recv got EOF from 127.12.159.193:37751 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Sep 23 19:36:41 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:41 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:41.498323 22179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:41.489579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:51267)
0923 19:36:41.490233 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:41.490254 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:41.490393 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:41.490701 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:41.490704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:41.491099 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:41.491263 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:41.491271 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.492257 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.492261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:41.493223 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:41.493233 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.494343 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.494350 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:41.494511 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:41.495190 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:41.495216 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:41.498091 (+ 2875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":386,"threads_started":1}
W20260923 19:36:41.498543 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:41.489663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:51267 (local address 127.12.159.254:41237)
0923 19:36:41.489922 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:41.489929 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:41.490366 (+ 437us) server_negotiation.cc:407] Connection header received
0923 19:36:41.490494 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:41.490498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:41.490576 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:41.490662 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:41.491395 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.492142 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.493373 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.494044 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.494185 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:41.498293 (+ 4108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:51267: BlockingRecv error: recv got EOF from 127.12.159.194:51267 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Sep 23 19:36:41 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:41 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:41.990489 22180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:41.981497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:53897)
0923 19:36:41.982165 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:41.982186 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:41.982330 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:41.982738 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:41.982743 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:41.983310 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:41.983541 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:41.983551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.984769 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.984773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:41.985770 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:41.985783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.986516 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.986520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:41.986665 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:41.987237 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:41.987255 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:41.990247 (+ 2992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":375,"threads_started":1}
W20260923 19:36:41.990715 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:41.981554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:53897 (local address 127.12.159.254:41237)
0923 19:36:41.981791 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:41.981825 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:41.982284 (+ 459us) server_negotiation.cc:407] Connection header received
0923 19:36:41.982453 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:41.982460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:41.982539 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:41.982624 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:41.983686 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.984622 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.985941 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:41.986379 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:41.986481 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:41.990458 (+ 3977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:53897: BlockingRecv error: recv got EOF from 127.12.159.195:53897 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Sep 23 19:36:42 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:42 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:42.042264 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:42.034069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:50743)
0923 19:36:42.034625 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:42.034641 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:42.034747 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:42.035059 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:42.035062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:42.035411 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:42.035557 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:42.035566 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.036557 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.036561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:42.037518 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:42.037530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.038253 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.038257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:42.038373 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:42.039031 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:42.039049 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:42.041944 (+ 2895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":320,"threads_started":1}
W20260923 19:36:42.042763 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:42.034214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:50743 (local address 127.12.159.254:41237)
0923 19:36:42.034400 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:42.034405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:42.034712 (+ 307us) server_negotiation.cc:407] Connection header received
0923 19:36:42.034841 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:42.034844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:42.034906 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:42.034991 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:42.035673 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.036427 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.037681 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.038114 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.038208 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:42.042238 (+ 4030us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:50743: BlockingRecv error: recv got EOF from 127.12.159.193:50743 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Sep 23 19:36:42 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:42 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:42.508387 22182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:42.499372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:59537)
0923 19:36:42.499910 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:42.499926 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:42.500045 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:42.500604 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:42.500608 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:42.501016 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:42.501185 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:42.501195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.502396 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.502400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:42.503523 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:42.503535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.504175 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.504180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:42.504287 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:42.504940 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:42.504967 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:42.508168 (+ 3201us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":328,"threads_started":1}
W20260923 19:36:42.508584 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:42.499419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:59537 (local address 127.12.159.254:41237)
0923 19:36:42.499603 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:42.499607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:42.500006 (+ 399us) server_negotiation.cc:407] Connection header received
0923 19:36:42.500189 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:42.500193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:42.500272 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:42.500528 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:42.501338 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.502247 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.503634 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.504051 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.504142 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:42.508350 (+ 4208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:59537: BlockingRecv error: recv got EOF from 127.12.159.194:59537 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Sep 23 19:36:42 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:42 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:42.999840 22183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:42.991401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:52429)
0923 19:36:42.991928 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:42.991948 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:42.992111 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:42.992427 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:42.992431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:42.992826 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:42.992964 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:42.992972 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.994060 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.994066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:42.995012 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:42.995023 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.995714 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.995720 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:42.995886 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:42.996510 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:42.996527 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:42.999494 (+ 2967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":278,"threads_started":1}
W20260923 19:36:42.999938 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:42.991649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:52429 (local address 127.12.159.254:41237)
0923 19:36:42.991936 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:42.991945 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:42.992036 (+ 91us) server_negotiation.cc:407] Connection header received
0923 19:36:42.992230 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:42.992235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:42.992299 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:42.992398 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:42.993163 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.993929 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.995156 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:42.995570 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:42.995698 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:42.999694 (+ 3996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:52429: BlockingRecv error: recv got EOF from 127.12.159.195:52429 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
Sep 23 19:36:43 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:43 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:43.052652 22184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:43.043289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:56731)
0923 19:36:43.043833 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:43.043849 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:43.043959 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:43.044324 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:43.044327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:43.044988 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:43.045209 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:43.045219 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.046474 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.046478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:43.047687 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:43.047700 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.048555 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.048562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:43.048740 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:43.049332 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:43.049349 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:43.052408 (+ 3059us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":302,"threads_started":1}
W20260923 19:36:43.052884 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:43.043369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56731 (local address 127.12.159.254:41237)
0923 19:36:43.043589 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:43.043594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:43.043928 (+ 334us) server_negotiation.cc:407] Connection header received
0923 19:36:43.044120 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:43.044124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:43.044191 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:43.044284 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:43.045380 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.046326 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.047835 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.048400 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.048536 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:43.052628 (+ 4092us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:56731: BlockingRecv error: recv got EOF from 127.12.159.193:56731 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Sep 23 19:36:43 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:43 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:43.518338 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:43.509391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:40525)
0923 19:36:43.510022 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:43.510039 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:43.510217 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:43.510565 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:43.510569 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:43.510987 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:43.511200 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:43.511209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.512280 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.512283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:43.513297 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:43.513308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.514180 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.514187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:43.514375 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:43.515092 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:43.515112 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:43.518093 (+ 2981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":321,"threads_started":1}
W20260923 19:36:43.518553 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:43.509516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:40525 (local address 127.12.159.254:41237)
0923 19:36:43.509774 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:43.509781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:43.510175 (+ 394us) server_negotiation.cc:407] Connection header received
0923 19:36:43.510333 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:43.510337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:43.510409 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:43.510485 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:43.511336 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.512148 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.513439 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:43.514020 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:43.514163 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:43.518285 (+ 4122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:40525: BlockingRecv error: recv got EOF from 127.12.159.194:40525 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Sep 23 19:36:44 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:44 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:44.019870 22186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:44.000897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:35787)
0923 19:36:44.001468 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:44.001486 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:44.001650 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:44.002075 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:44.002080 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:44.002598 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:44.002916 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:44.002926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.004289 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.004297 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:44.005283 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:44.005294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.006078 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.006086 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:44.006279 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:44.016694 (+ 10415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:44.016719 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:44.019634 (+ 2915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":320,"threads_started":1}
W20260923 19:36:44.020117 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:44.000979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:35787 (local address 127.12.159.254:41237)
0923 19:36:44.001258 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:44.001266 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:44.001574 (+ 308us) server_negotiation.cc:407] Connection header received
0923 19:36:44.001843 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:44.001850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:44.001928 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:44.002039 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:44.003149 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.004165 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.005432 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.005923 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.006064 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:44.019865 (+ 13801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:35787: BlockingRecv error: recv got EOF from 127.12.159.195:35787 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Sep 23 19:36:44 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:44 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:44.062095 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:44.053632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:55729)
0923 19:36:44.054190 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:44.054206 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:44.054318 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:44.054603 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:44.054606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:44.054988 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:44.055187 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:44.055197 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.056196 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.056200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:44.057261 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:44.057272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.058133 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.058137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:44.058298 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:44.058864 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:44.058881 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:44.061749 (+ 2868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":319,"threads_started":1}
W20260923 19:36:44.062327 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:44.053688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:55729 (local address 127.12.159.254:41237)
0923 19:36:44.053943 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:44.053952 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:44.054287 (+ 335us) server_negotiation.cc:407] Connection header received
0923 19:36:44.054414 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:44.054417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:44.054479 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:44.054560 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:44.055310 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.056064 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.057418 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.057983 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.058082 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:44.062038 (+ 3956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:55729: BlockingRecv error: recv got EOF from 127.12.159.193:55729 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Sep 23 19:36:44 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:44 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:44.530927 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:44.519365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:53795)
0923 19:36:44.519804 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:44.519873 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:44.520024 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:44.520726 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:44.520731 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:44.521306 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:44.521502 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:44.521514 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.523165 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.523182 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:44.524736 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:44.524751 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.525906 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.525914 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:44.526193 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:44.527064 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:44.527115 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:44.530683 (+ 3568us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":255,"threads_started":1}
W20260923 19:36:44.531113 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:44.519463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:53795 (local address 127.12.159.254:41237)
0923 19:36:44.519720 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:44.519726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:44.519962 (+ 236us) server_negotiation.cc:407] Connection header received
0923 19:36:44.520427 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:44.520431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:44.520526 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:44.520638 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:44.521664 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.522977 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.524898 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:44.525652 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:44.525832 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:44.530885 (+ 5053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:53795: BlockingRecv error: recv got EOF from 127.12.159.194:53795 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Sep 23 19:36:45 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:45 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:45.029361 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:45.020907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:45795)
0923 19:36:45.021471 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:45.021487 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:45.021671 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:45.022057 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:45.022062 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:45.022655 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:45.022815 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:45.022823 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.023771 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.023778 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:45.024672 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:45.024682 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.025384 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.025390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:45.025577 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:45.026185 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:45.026203 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:45.029061 (+ 2858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":326,"threads_started":1}
W20260923 19:36:45.029462 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:45.020990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:45795 (local address 127.12.159.254:41237)
0923 19:36:45.021263 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:45.021272 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:45.021566 (+ 294us) server_negotiation.cc:407] Connection header received
0923 19:36:45.021845 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:45.021851 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:45.021927 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:45.022033 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:45.022953 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.023636 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.024815 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.025221 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.025381 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:45.029229 (+ 3848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:45795: BlockingRecv error: recv got EOF from 127.12.159.195:45795 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Sep 23 19:36:45 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:45 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:45.071679 22190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:45.062990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:56741)
0923 19:36:45.063457 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:45.063473 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:45.063586 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:45.063901 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:45.063905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:45.064358 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:45.064528 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:45.064538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.065490 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.065494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:45.066448 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:45.066459 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.067194 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.067198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:45.067310 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:45.067885 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:45.067902 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:45.071316 (+ 3414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":233,"threads_started":1}
W20260923 19:36:45.072052 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:45.063075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56741 (local address 127.12.159.254:41237)
0923 19:36:45.063325 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:45.063331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:45.063549 (+ 218us) server_negotiation.cc:407] Connection header received
0923 19:36:45.063683 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:45.063687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:45.063761 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:45.063842 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:45.064662 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.065371 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.066594 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.067025 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.067136 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:45.071529 (+ 4393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:56741: BlockingRecv error: recv got EOF from 127.12.159.193:56741 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Sep 23 19:36:45 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:45 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:45.540325 22191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:45.531942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:57275)
0923 19:36:45.532481 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:45.532502 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:45.532651 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:45.532999 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:45.533003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:45.533505 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:45.533688 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:45.533698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.534780 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.534786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:45.535722 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:45.535733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.536457 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.536464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:45.536634 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:45.537227 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:45.537244 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:45.539969 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":241,"threads_started":1}
W20260923 19:36:45.540383 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:45.532146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:57275 (local address 127.12.159.254:41237)
0923 19:36:45.532349 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:45.532355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:45.532587 (+ 232us) server_negotiation.cc:407] Connection header received
0923 19:36:45.532793 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:45.532803 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:45.532866 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:45.532977 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:45.533863 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.534646 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.535866 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:45.536275 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:45.536398 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:45.540159 (+ 3761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:57275: BlockingRecv error: recv got EOF from 127.12.159.194:57275 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Sep 23 19:36:46 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:46 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:46.046465 22192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:46.030361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:37235)
0923 19:36:46.031342 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:46.031359 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:46.031484 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:46.031851 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:46.031854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:46.032243 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:46.032413 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:46.032423 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.033514 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.033518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:46.034568 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:46.034582 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.035484 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.035489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:46.035759 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:46.042782 (+ 7023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:46.042805 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:46.046194 (+ 3389us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":879,"thread_start_us":436,"threads_started":1}
W20260923 19:36:46.046770 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:46.030548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:37235 (local address 127.12.159.254:41237)
0923 19:36:46.030760 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:46.030765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:46.031469 (+ 704us) server_negotiation.cc:407] Connection header received
0923 19:36:46.031604 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:46.031608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:46.031681 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:46.031761 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:46.032559 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.033355 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.034796 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.035320 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.035438 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:46.046473 (+ 11035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:37235: BlockingRecv error: recv got EOF from 127.12.159.195:37235 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Sep 23 19:36:46 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:46 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:46.081104 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:46.072719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:57883)
0923 19:36:46.073233 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:46.073253 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:46.073420 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:46.073882 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:46.073889 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:46.074303 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:46.074487 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:46.074497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.075516 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.075520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:46.076451 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:46.076463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.077248 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.077252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:46.077371 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:46.078065 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:46.078084 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:46.080870 (+ 2786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":538,"threads_started":1}
W20260923 19:36:46.081277 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:46.072927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:57883 (local address 127.12.159.254:41237)
0923 19:36:46.073288 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:46.073296 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:46.073316 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:36:46.073558 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:46.073562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:46.073654 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:46.073767 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:46.074623 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.075383 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.076647 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.077107 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.077218 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:46.081056 (+ 3838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:57883: BlockingRecv error: recv got EOF from 127.12.159.193:57883 (error 108)
Metrics: {"server-negotiator.queue_time_us":235}
Sep 23 19:36:46 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:46 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:46.550105 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:46.541315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:50057)
0923 19:36:46.541792 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:46.541867 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:46.542015 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:46.542312 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:46.542315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:46.542653 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:46.542925 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:46.542936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.544059 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.544063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:46.544967 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:46.544978 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.545635 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.545639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:46.545779 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:46.546598 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:46.546615 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:46.549649 (+ 3034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":238,"threads_started":1}
W20260923 19:36:46.550225 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:46.541403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:50057 (local address 127.12.159.254:41237)
0923 19:36:46.541647 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:46.541653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:46.541967 (+ 314us) server_negotiation.cc:407] Connection header received
0923 19:36:46.542114 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:46.542118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:46.542179 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:46.542257 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:46.543052 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.543891 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.545087 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:46.545515 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:46.545606 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:46.549968 (+ 4362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:50057: BlockingRecv error: recv got EOF from 127.12.159.194:50057 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Sep 23 19:36:47 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:47 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.195@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:47.056210 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:47.047479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.195:38197)
0923 19:36:47.048008 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:47.048025 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:47.048143 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:47.048454 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:47.048457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:47.048783 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:47.049003 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:47.049012 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.050064 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.050069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:47.051014 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:47.051026 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.051753 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.051758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:47.051924 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.052617 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:47.052635 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:47.055776 (+ 3141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":258,"threads_started":1}
W20260923 19:36:47.056324 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:47.047548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:38197 (local address 127.12.159.254:41237)
0923 19:36:47.047807 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:47.047816 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:47.048108 (+ 292us) server_negotiation.cc:407] Connection header received
0923 19:36:47.048240 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:47.048244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:47.048304 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:47.048414 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:47.049131 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.049922 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.051161 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.051606 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.051716 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.055983 (+ 4267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.195:38197: BlockingRecv error: recv got EOF from 127.12.159.195:38197 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Sep 23 19:36:47 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:47 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.193@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:47.090984 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:47.082366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.193:35465)
0923 19:36:47.082990 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:47.083008 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:47.083140 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:47.083442 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:47.083445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:47.083992 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:47.084173 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:47.084183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.085285 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.085289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:47.086365 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:47.086378 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.087028 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.087032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:47.087156 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.087733 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:47.087753 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:47.090686 (+ 2933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":315,"threads_started":1}
W20260923 19:36:47.091116 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:47.082528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:35465 (local address 127.12.159.254:41237)
0923 19:36:47.082771 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:47.082777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:47.083092 (+ 315us) server_negotiation.cc:407] Connection header received
0923 19:36:47.083248 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:47.083252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:47.083312 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:47.083487 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:47.084308 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.085148 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.086495 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.086885 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.086985 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.090885 (+ 3900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.193:35465: BlockingRecv error: recv got EOF from 127.12.159.193:35465 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Sep 23 19:36:47 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:36:47 dist-test-slave-lzv7 krb5kdc[21150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.159.194@KRBTEST.COM for oryx/127.12.159.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:36:47.560256 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:47.551428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41237 (local address 127.12.159.194:57093)
0923 19:36:47.552001 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:47.552017 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:47.552139 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:47.552527 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:47.552531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:47.552972 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:47.553159 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:47.553169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.554311 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.554315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:47.555259 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:47.555271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.555967 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.555972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:47.556143 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.556829 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:47.556846 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:47.559994 (+ 3148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.159.254:41237: Server oryx/127.12.159.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":308,"threads_started":1}
W20260923 19:36:47.560397 21889 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:47.551518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:57093 (local address 127.12.159.254:41237)
0923 19:36:47.551711 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:47.551716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:47.552144 (+ 428us) server_negotiation.cc:407] Connection header received
0923 19:36:47.552238 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:47.552243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:47.552325 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:47.552436 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:47.553312 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.554164 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.555394 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.555830 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.555922 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.560184 (+ 4262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.159.194:57093: BlockingRecv error: recv got EOF from 127.12.159.194:57093 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:36:47.862912 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21739
I20260923 19:36:47.875499 22199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:47.864096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39096 (local address 127.12.159.193:38227)
0923 19:36:47.864759 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:47.864767 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:47.864797 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:36:47.864861 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:47.864868 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:47.865113 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:47.865280 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:47.866730 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.867820 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.868986 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.869577 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.869702 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.872319 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:47.872329 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:47.872343 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:47.872379 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:47.874896 (+ 2517us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.159.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0923 19:36:47.875198 (+ 302us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39096: Request ticket server kudu/127.12.159.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":287,"threads_started":1}
W20260923 19:36:47.875625 22199 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39096: Request ticket server kudu/127.12.159.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260923 19:36:47.875664 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21739: Not authorized: Client connection negotiation failed: client connection to 127.12.159.193:38227: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.159.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260923 19:36:47.875902 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 21739
I20260923 19:36:47.894057 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21890
I20260923 19:36:47.906435 22200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:47.895057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50064 (local address 127.12.159.194:34083)
0923 19:36:47.895645 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:47.895652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:47.895686 (+ 34us) server_negotiation.cc:407] Connection header received
0923 19:36:47.895752 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:47.895758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:47.895987 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:47.896142 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:47.897395 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.898585 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.899743 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.900323 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.900418 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.903091 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:47.903099 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:47.903114 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:47.903149 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:47.905934 (+ 2785us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.159.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0923 19:36:47.906202 (+ 268us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50064: Request ticket server kudu/127.12.159.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":270,"threads_started":1}
W20260923 19:36:47.906548 22200 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50064: Request ticket server kudu/127.12.159.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260923 19:36:47.906692 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21890: Not authorized: Client connection negotiation failed: client connection to 127.12.159.194:34083: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.159.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260923 19:36:47.906867 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 21890
I20260923 19:36:47.923414 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22021
I20260923 19:36:47.935434 22201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:47.924444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55882 (local address 127.12.159.195:36281)
0923 19:36:47.925040 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:47.925048 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:47.925079 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:36:47.925155 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:47.925162 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:47.925405 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:47.925561 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:47.926838 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.927886 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.929006 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:47.929535 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:47.929628 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:47.932206 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:47.932215 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:47.932228 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:47.932275 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:47.934875 (+ 2600us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.159.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0923 19:36:47.935124 (+ 249us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55882: Request ticket server kudu/127.12.159.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":336,"threads_started":1}
W20260923 19:36:47.935563 22201 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55882: Request ticket server kudu/127.12.159.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260923 19:36:47.935633 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22021: Not authorized: Client connection negotiation failed: client connection to 127.12.159.195:36281: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.159.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260923 19:36:47.935803 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22021
I20260923 19:36:47.952240 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 21670
I20260923 19:36:47.953516 21732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:48.070538 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 21670
2026-09-23T19:36:48Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21268 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-23T19:36:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:48Z Disabled control of system clock
I20260923 19:36:48.148315 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:35115
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:41681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:35115
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 19:36:48.482862 22206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:48.483155 22206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:48.483242 22206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:48.490633 22206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:48.490746 22206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:48.490782 22206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:48.490833 22206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:48.490877 22206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:48.500052 22206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:35115
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:35115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:48.501332 22206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:48.503060 22206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:48.514900 22211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:48.515007 22212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:48.514935 22214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:48.515952 22206 server_base.cc:1034] running on GCE node
I20260923 19:36:48.516759 22206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:48.518280 22206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:48.519526 22206 hybrid_clock.cc:648] HybridClock initialized: now 1790192208519481 us; error 38 us; skew 500 ppm
I20260923 19:36:48.519893 22206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:48.523340 22206 webserver.cc:460] Webserver started at http://127.12.159.254:38815/ using document root <none> and password file <none>
I20260923 19:36:48.524307 22206 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:48.524446 22206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:48.524837 22206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:48.529120 22206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "43820f6441a44cb695dcc43956bae8b9"
format_stamp: "Formatted at 2026-09-23 19:36:48 on dist-test-slave-lzv7"
server_key: "c7e9dd2a1455668192fe3eeba83abd69"
server_key_iv: "7a34180bbf464b6125713504f7cd53ff"
server_key_version: "encryptionkey@0"
I20260923 19:36:48.530279 22206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "43820f6441a44cb695dcc43956bae8b9"
format_stamp: "Formatted at 2026-09-23 19:36:48 on dist-test-slave-lzv7"
server_key: "c7e9dd2a1455668192fe3eeba83abd69"
server_key_iv: "7a34180bbf464b6125713504f7cd53ff"
server_key_version: "encryptionkey@0"
I20260923 19:36:48.535593 22206 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:36:48.539393 22220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:48.540836 22206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:36:48.541050 22206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "43820f6441a44cb695dcc43956bae8b9"
format_stamp: "Formatted at 2026-09-23 19:36:48 on dist-test-slave-lzv7"
server_key: "c7e9dd2a1455668192fe3eeba83abd69"
server_key_iv: "7a34180bbf464b6125713504f7cd53ff"
server_key_version: "encryptionkey@0"
I20260923 19:36:48.541330 22206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:48.558008 22206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:48.558815 22206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:48.559092 22206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:48.578423 22206 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:35115
I20260923 19:36:48.578460 22271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:35115 every 8 connection(s)
I20260923 19:36:48.579826 22206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:48.580907 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22206
I20260923 19:36:48.581123 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:48.581748 12927 external_mini_cluster.cc:1428] Setting key edc3f7003e7f4cabb8d414c182109743
I20260923 19:36:48.584401 22272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:48.595750 22272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9: Bootstrap starting.
I20260923 19:36:48.596132 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:48.583794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37278 (local address 127.12.159.254:35115)
0923 19:36:48.584902 (+ 1108us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:48.584915 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:48.584960 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:36:48.586736 (+ 1776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:48.586759 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:48.587274 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:48.587703 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:48.588342 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:48.589862 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:48.591292 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:48.592020 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:48.592249 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:48.593596 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:48.593604 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:48.593618 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:48.594276 (+ 658us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:48.594355 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:48.594378 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:48.594524 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:48.594761 (+ 237us) server_negotiation.cc:299] Negotiation successful
0923 19:36:48.595087 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":355,"threads_started":1}
I20260923 19:36:48.598973 22272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:48.599979 22272 log.cc:824] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:48.602931 22272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9: No bootstrap required, opened a new log
I20260923 19:36:48.610157 22272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43820f6441a44cb695dcc43956bae8b9" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 35115 } }
I20260923 19:36:48.610558 22272 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:48.610631 22272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43820f6441a44cb695dcc43956bae8b9, State: Initialized, Role: FOLLOWER
I20260923 19:36:48.611119 22272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43820f6441a44cb695dcc43956bae8b9" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 35115 } }
I20260923 19:36:48.611315 22272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:48.611416 22272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:48.611542 22272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:48.613536 22272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43820f6441a44cb695dcc43956bae8b9" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 35115 } }
I20260923 19:36:48.614089 22272 leader_election.cc:302] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43820f6441a44cb695dcc43956bae8b9; no voters:
I20260923 19:36:48.614647 22272 leader_election.cc:288] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:48.614814 22277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:48.615957 22277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [term 1 LEADER]: Becoming Leader. State: Replica: 43820f6441a44cb695dcc43956bae8b9, State: Running, Role: LEADER
I20260923 19:36:48.616600 22277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43820f6441a44cb695dcc43956bae8b9" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 35115 } }
I20260923 19:36:48.616907 22272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:48.619469 22279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43820f6441a44cb695dcc43956bae8b9. Latest consensus state: current_term: 1 leader_uuid: "43820f6441a44cb695dcc43956bae8b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43820f6441a44cb695dcc43956bae8b9" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 35115 } } }
I20260923 19:36:48.619573 22278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43820f6441a44cb695dcc43956bae8b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43820f6441a44cb695dcc43956bae8b9" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 35115 } } }
I20260923 19:36:48.619969 22279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:48.619993 22278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:48.621999 22285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:48.627308 22285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:48.636091 22285 catalog_manager.cc:1347] Generated new cluster ID: db220ef4272141e4bb6b8a6976303830
I20260923 19:36:48.636200 22285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:48.651254 22285 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:48.652944 22285 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:48.664162 22285 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43820f6441a44cb695dcc43956bae8b9: Generated new TSK 0
I20260923 19:36:48.665017 22285 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:36:48.681255 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:35115
--builtin_ntp_servers=127.12.159.212:41681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260923 19:36:49.023161 22296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:49.023424 22296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:49.023559 22296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:49.030727 22296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:49.030828 22296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:49.030994 22296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:49.040473 22296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:35115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:49.041750 22296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:49.043640 22296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:49.056969 22304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:49.056970 22301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:49.057008 22302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:49.058270 22296 server_base.cc:1034] running on GCE node
I20260923 19:36:49.058996 22296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:49.060000 22296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:49.061247 22296 hybrid_clock.cc:648] HybridClock initialized: now 1790192209061183 us; error 61 us; skew 500 ppm
I20260923 19:36:49.061609 22296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:49.071246 22296 webserver.cc:460] Webserver started at http://127.12.159.193:43423/ using document root <none> and password file <none>
I20260923 19:36:49.072070 22296 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:49.072213 22296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:49.072559 22296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:49.075603 22296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "11c305ce0d714a03a887ad2c54c57cad"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "7d5866b36c8f12f68d0e1dd5928938b6"
server_key_iv: "0c244db53b337276a0411f3327639645"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.076424 22296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "11c305ce0d714a03a887ad2c54c57cad"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "7d5866b36c8f12f68d0e1dd5928938b6"
server_key_iv: "0c244db53b337276a0411f3327639645"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.081738 22296 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:36:49.085379 22310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:49.086782 22296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:36:49.086964 22296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "11c305ce0d714a03a887ad2c54c57cad"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "7d5866b36c8f12f68d0e1dd5928938b6"
server_key_iv: "0c244db53b337276a0411f3327639645"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.087177 22296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:49.102391 22296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:49.103212 22296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:49.103504 22296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:49.104445 22296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:49.105890 22296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:49.106022 22296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:49.106156 22296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:49.106242 22296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:49.139232 22296 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:37331
I20260923 19:36:49.139284 22422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:37331 every 8 connection(s)
I20260923 19:36:49.140547 22296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:49.147022 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22296
I20260923 19:36:49.147233 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:36:49.147893 12927 external_mini_cluster.cc:1428] Setting key 57724c9946a538dca72437ffb8a3129c
I20260923 19:36:49.150686 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:35115
--builtin_ntp_servers=127.12.159.212:41681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 19:36:49.153729 22425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:49.143022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:44907 (local address 127.12.159.254:35115)
0923 19:36:49.143517 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:49.143522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:49.144579 (+ 1057us) server_negotiation.cc:407] Connection header received
0923 19:36:49.146536 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:49.146543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:49.146644 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:49.146787 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:49.148052 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.148969 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.150823 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.151252 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.151392 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:49.152867 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:49.152872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:49.152875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:49.152893 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:49.152937 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:49.152951 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:49.153051 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:49.153278 (+ 227us) server_negotiation.cc:299] Negotiation successful
0923 19:36:49.153375 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":251,"threads_started":1}
I20260923 19:36:49.154814 22426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:49.143457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:35115 (local address 127.12.159.193:44907)
0923 19:36:49.144321 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:49.144362 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:49.146108 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:49.147023 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:49.147031 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:49.147129 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:49.147852 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:49.147869 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.149125 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.149132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:49.150660 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:49.150673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.151517 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.151525 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:49.151772 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:49.152533 (+ 761us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:36:49.152536 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:49.152578 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:36:49.152660 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:49.153049 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:49.153063 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:49.153073 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 19:36:49.153268 (+ 195us) client_negotiation.cc:240] Negotiation successful
0923 19:36:49.153685 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":260,"threads_started":1}
I20260923 19:36:49.156406 22423 heartbeater.cc:347] Connected to a master server at 127.12.159.254:35115
I20260923 19:36:49.156715 22423 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:49.157423 22423 heartbeater.cc:511] Master 127.12.159.254:35115 requested a full tablet report, sending...
I20260923 19:36:49.159727 22237 ts_manager.cc:194] Registered new tserver with Master: 11c305ce0d714a03a887ad2c54c57cad (127.12.159.193:37331)
I20260923 19:36:49.161942 22237 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.193:44907
W20260923 19:36:49.481205 22427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:49.481498 22427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:49.481583 22427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:49.488956 22427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:49.489061 22427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:49.489168 22427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:49.498287 22427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:35115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:49.499483 22427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:49.501289 22427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:49.514655 22433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:49.514606 22435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:49.514706 22432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:49.519186 22427 server_base.cc:1034] running on GCE node
I20260923 19:36:49.519788 22427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:49.520810 22427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:49.522013 22427 hybrid_clock.cc:648] HybridClock initialized: now 1790192209521952 us; error 73 us; skew 500 ppm
I20260923 19:36:49.522356 22427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:49.524832 22427 webserver.cc:460] Webserver started at http://127.12.159.194:43797/ using document root <none> and password file <none>
I20260923 19:36:49.525545 22427 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:49.525696 22427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:49.526069 22427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:49.528957 22427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "5486f0e5a834472a8de187fead1d6e8f"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "35ad60a40b1297ac4d13a416b4b5c075"
server_key_iv: "f794d0ebf0679887f339f2dece9579fc"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.529744 22427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "5486f0e5a834472a8de187fead1d6e8f"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "35ad60a40b1297ac4d13a416b4b5c075"
server_key_iv: "f794d0ebf0679887f339f2dece9579fc"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.534858 22427 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260923 19:36:49.538270 22441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:49.539765 22427 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:36:49.539940 22427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "5486f0e5a834472a8de187fead1d6e8f"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "35ad60a40b1297ac4d13a416b4b5c075"
server_key_iv: "f794d0ebf0679887f339f2dece9579fc"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.540154 22427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:49.553094 22427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:49.553972 22427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:49.554271 22427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:49.555226 22427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:49.556579 22427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:49.556699 22427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:49.556826 22427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:49.556915 22427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:49.590381 22427 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:44105
I20260923 19:36:49.590402 22553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:44105 every 8 connection(s)
I20260923 19:36:49.591812 22427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:49.595867 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22427
I20260923 19:36:49.596056 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:36:49.596506 12927 external_mini_cluster.cc:1428] Setting key 1f874a8e2138bd8667398e3c9e9fea5f
I20260923 19:36:49.599128 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:35115
--builtin_ntp_servers=127.12.159.212:41681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 19:36:49.604849 22425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:49.594452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:47739 (local address 127.12.159.254:35115)
0923 19:36:49.594658 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:49.594665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:49.596157 (+ 1492us) server_negotiation.cc:407] Connection header received
0923 19:36:49.598129 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:49.598133 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:49.598191 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:49.598263 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:49.599388 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.600096 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.601687 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.602421 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.602561 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:49.603914 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:49.603923 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:49.603930 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:49.603954 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:49.603993 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:49.604010 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:49.604107 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:49.604345 (+ 238us) server_negotiation.cc:299] Negotiation successful
0923 19:36:49.604456 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:36:49.605971 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:49.594944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:35115 (local address 127.12.159.194:47739)
0923 19:36:49.595995 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:49.596041 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:49.597880 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:49.598498 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:49.598506 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:49.598596 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:49.599157 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:49.599173 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.600282 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.600286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:49.601528 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:49.601540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:49.602649 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:49.602654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:49.602868 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:49.603596 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:36:49.603598 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:49.603641 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:36:49.603716 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:49.604132 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:49.604141 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:49.604147 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:36:49.604316 (+ 169us) client_negotiation.cc:240] Negotiation successful
0923 19:36:49.604613 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":280,"threads_started":1}
I20260923 19:36:49.607458 22554 heartbeater.cc:347] Connected to a master server at 127.12.159.254:35115
I20260923 19:36:49.607767 22554 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:49.608551 22554 heartbeater.cc:511] Master 127.12.159.254:35115 requested a full tablet report, sending...
I20260923 19:36:49.609963 22237 ts_manager.cc:194] Registered new tserver with Master: 5486f0e5a834472a8de187fead1d6e8f (127.12.159.194:44105)
I20260923 19:36:49.610759 22237 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.194:47739
W20260923 19:36:49.936844 22557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:49.937188 22557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:49.937352 22557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:49.945057 22557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:49.945192 22557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:49.945389 22557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:49.954731 22557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:35115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:49.956096 22557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:49.957947 22557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:49.971328 22563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:49.971405 22562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:49.971405 22565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:49.972553 22557 server_base.cc:1034] running on GCE node
I20260923 19:36:49.973202 22557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:49.974251 22557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:49.975466 22557 hybrid_clock.cc:648] HybridClock initialized: now 1790192209975377 us; error 62 us; skew 500 ppm
I20260923 19:36:49.975786 22557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:49.978113 22557 webserver.cc:460] Webserver started at http://127.12.159.195:33845/ using document root <none> and password file <none>
I20260923 19:36:49.978789 22557 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:49.978875 22557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:49.979146 22557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:49.981959 22557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "e9652cfcbe404a0097d0e0afbbb8bd6f"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "06c0410f804d36b5e439fbb90a2f4da6"
server_key_iv: "770c7e7f98e766c06458fa981f42819e"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.982729 22557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "e9652cfcbe404a0097d0e0afbbb8bd6f"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "06c0410f804d36b5e439fbb90a2f4da6"
server_key_iv: "770c7e7f98e766c06458fa981f42819e"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.987933 22557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:36:49.991551 22571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:49.992975 22557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:36:49.993120 22557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "e9652cfcbe404a0097d0e0afbbb8bd6f"
format_stamp: "Formatted at 2026-09-23 19:36:49 on dist-test-slave-lzv7"
server_key: "06c0410f804d36b5e439fbb90a2f4da6"
server_key_iv: "770c7e7f98e766c06458fa981f42819e"
server_key_version: "encryptionkey@0"
I20260923 19:36:49.993302 22557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:50.019795 22557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:50.020653 22557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:50.020911 22557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:50.021862 22557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:50.023411 22557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:50.023497 22557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:50.023577 22557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:50.023630 22557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:50.057375 22557 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:40589
I20260923 19:36:50.057468 22683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:40589 every 8 connection(s)
I20260923 19:36:50.058735 22557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:50.064043 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22557
I20260923 19:36:50.064266 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:36:50.064728 12927 external_mini_cluster.cc:1428] Setting key 2cea6b25aa671c9fce13d1932005678c
I20260923 19:36:50.072022 22425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:50.061423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:58399 (local address 127.12.159.254:35115)
0923 19:36:50.061676 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:50.061681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:50.063066 (+ 1385us) server_negotiation.cc:407] Connection header received
0923 19:36:50.065112 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:50.065118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:50.065216 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:50.065328 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:50.066535 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.067517 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.069251 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.069665 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.069779 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:50.071317 (+ 1538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:50.071322 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:50.071325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:50.071345 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:50.071376 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:50.071388 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:50.071466 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:50.071679 (+ 213us) server_negotiation.cc:299] Negotiation successful
0923 19:36:50.071760 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:36:50.073200 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:50.062018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:35115 (local address 127.12.159.195:58399)
0923 19:36:50.062909 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:50.062945 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:50.064808 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:50.065569 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:50.065578 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:50.065702 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:50.066373 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:50.066391 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.067746 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.067752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:50.069100 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:50.069113 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.070078 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.070085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:50.070303 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:50.070987 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:36:50.070990 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:50.071033 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:36:50.071122 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:50.071481 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:50.071489 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:50.071495 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:36:50.071638 (+ 143us) client_negotiation.cc:240] Negotiation successful
0923 19:36:50.071972 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":259,"threads_started":1}
I20260923 19:36:50.074781 22684 heartbeater.cc:347] Connected to a master server at 127.12.159.254:35115
I20260923 19:36:50.075071 22684 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:50.075860 22684 heartbeater.cc:511] Master 127.12.159.254:35115 requested a full tablet report, sending...
I20260923 19:36:50.077374 22237 ts_manager.cc:194] Registered new tserver with Master: e9652cfcbe404a0097d0e0afbbb8bd6f (127.12.159.195:40589)
I20260923 19:36:50.078356 22237 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.195:58399
I20260923 19:36:50.080547 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 19:36:50.086830 22425 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:50.085125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37282 (local address 127.12.159.254:35115)
0923 19:36:50.085409 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:50.085418 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:50.085973 (+ 555us) server_negotiation.cc:407] Connection header received
0923 19:36:50.086116 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:50.086120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:50.086193 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:50.086275 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:50.086610 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37282: BlockingRecv error: recv got EOF from 127.0.0.1:37282 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:36:50.087563 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22296
I20260923 19:36:50.095687 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:50.088471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60842 (local address 127.12.159.193:37331)
0923 19:36:50.088954 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:50.088961 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:50.088989 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:36:50.089048 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:50.089056 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:50.089267 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:50.089400 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:50.089711 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.090993 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.092281 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.092861 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.092971 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:50.094188 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:50.094198 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:50.094211 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:50.094818 (+ 607us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:50.094866 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:50.094886 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:50.095034 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:50.095172 (+ 138us) server_negotiation.cc:299] Negotiation successful
0923 19:36:50.095304 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":236,"threads_started":1}
I20260923 19:36:50.097014 22418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:50.177865 22423 heartbeater.cc:503] Master 127.12.159.254:35115 was elected leader, sending a full tablet report...
I20260923 19:36:50.178982 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22296
W20260923 19:36:50.197279 22223 connection.cc:535] server connection from 127.12.159.193:44907 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:36:50.197558 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22427
I20260923 19:36:50.204923 22695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:50.198531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56742 (local address 127.12.159.194:44105)
0923 19:36:50.198993 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:50.199000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:50.199027 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:36:50.199093 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:50.199100 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:50.199332 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:50.199461 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:50.199779 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.200755 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.202009 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.202579 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.202676 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:50.203640 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:50.203649 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:50.203663 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:50.204258 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:50.204303 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:50.204322 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:50.204415 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:50.204507 (+ 92us) server_negotiation.cc:299] Negotiation successful
0923 19:36:50.204628 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":230,"threads_started":1}
I20260923 19:36:50.206176 22549 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:50.288146 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22427
I20260923 19:36:50.304679 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22557
I20260923 19:36:50.313205 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:50.305616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55002 (local address 127.12.159.195:40589)
0923 19:36:50.306269 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:50.306302 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:50.306333 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:36:50.306392 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:50.306399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:50.306614 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:50.306738 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:50.307143 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.308205 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.309485 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:50.310225 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:50.310351 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:50.311727 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:50.311735 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:50.311748 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:50.312358 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:50.312403 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:50.312422 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:50.312554 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:50.312733 (+ 179us) server_negotiation.cc:299] Negotiation successful
0923 19:36:50.312859 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":369,"threads_started":1}
I20260923 19:36:50.314666 22679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:50.398113 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22557
I20260923 19:36:50.414831 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22206
I20260923 19:36:50.416149 22267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:50.519886 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22206
2026-09-23T19:36:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2446 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-23T19:36:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:50Z Disabled control of system clock
I20260923 19:36:50.594759 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:46337
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:36377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:46337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 19:36:50.927479 22703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:50.927778 22703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:50.927870 22703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:50.935313 22703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:50.935429 22703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:50.935467 22703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:50.935516 22703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:50.935561 22703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:50.945207 22703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:36377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:46337
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:46337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:50.946514 22703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:50.948280 22703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:50.960309 22708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:50.960376 22711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:50.960410 22709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:50.961565 22703 server_base.cc:1034] running on GCE node
I20260923 19:36:50.962400 22703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:50.963829 22703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:50.965093 22703 hybrid_clock.cc:648] HybridClock initialized: now 1790192210965057 us; error 61 us; skew 500 ppm
I20260923 19:36:50.965477 22703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:50.967984 22703 webserver.cc:460] Webserver started at http://127.12.159.254:36299/ using document root <none> and password file <none>
I20260923 19:36:50.968711 22703 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:50.968842 22703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:50.969178 22703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:50.973934 22703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "fbe9502b730049e6ad889b71face0adc"
format_stamp: "Formatted at 2026-09-23 19:36:50 on dist-test-slave-lzv7"
server_key: "f2b510f79b2f0167095dce5261913da2"
server_key_iv: "ca499f8efeba2946ad17553991682055"
server_key_version: "encryptionkey@0"
I20260923 19:36:50.974795 22703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "fbe9502b730049e6ad889b71face0adc"
format_stamp: "Formatted at 2026-09-23 19:36:50 on dist-test-slave-lzv7"
server_key: "f2b510f79b2f0167095dce5261913da2"
server_key_iv: "ca499f8efeba2946ad17553991682055"
server_key_version: "encryptionkey@0"
I20260923 19:36:50.980341 22703 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260923 19:36:50.983956 22717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:50.985404 22703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:36:50.985616 22703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "fbe9502b730049e6ad889b71face0adc"
format_stamp: "Formatted at 2026-09-23 19:36:50 on dist-test-slave-lzv7"
server_key: "f2b510f79b2f0167095dce5261913da2"
server_key_iv: "ca499f8efeba2946ad17553991682055"
server_key_version: "encryptionkey@0"
I20260923 19:36:50.985922 22703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:50.991904 22703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:50.992673 22703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:50.992971 22703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:51.011699 22703 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:46337
I20260923 19:36:51.011736 22768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:46337 every 8 connection(s)
I20260923 19:36:51.013077 22703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:51.016472 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22703
I20260923 19:36:51.016685 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:51.017017 22769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:51.017365 12927 external_mini_cluster.cc:1428] Setting key d89f3addb1052b4d2377e4784bbb1788
I20260923 19:36:51.026661 22772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:51.019445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57414 (local address 127.12.159.254:46337)
0923 19:36:51.020591 (+ 1146us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:51.020603 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:51.020645 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:36:51.022989 (+ 2344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:51.023012 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:51.023472 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:51.023812 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:51.025019 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:51.025025 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:51.025038 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:51.025053 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:51.025116 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:51.025131 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:51.025302 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:51.025402 (+ 100us) server_negotiation.cc:299] Negotiation successful
0923 19:36:51.025692 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":423,"threads_started":1}
I20260923 19:36:51.030663 22769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc: Bootstrap starting.
I20260923 19:36:51.033600 22769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:51.034731 22769 log.cc:824] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:51.037572 22769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc: No bootstrap required, opened a new log
I20260923 19:36:51.045550 22769 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe9502b730049e6ad889b71face0adc" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46337 } }
I20260923 19:36:51.046085 22769 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:51.046171 22769 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe9502b730049e6ad889b71face0adc, State: Initialized, Role: FOLLOWER
I20260923 19:36:51.046729 22769 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe9502b730049e6ad889b71face0adc" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46337 } }
I20260923 19:36:51.046924 22769 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:51.047016 22769 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:51.047143 22769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:51.049214 22769 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe9502b730049e6ad889b71face0adc" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46337 } }
I20260923 19:36:51.049681 22769 leader_election.cc:302] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbe9502b730049e6ad889b71face0adc; no voters:
I20260923 19:36:51.050349 22769 leader_election.cc:288] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:51.050513 22774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:51.051225 22774 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [term 1 LEADER]: Becoming Leader. State: Replica: fbe9502b730049e6ad889b71face0adc, State: Running, Role: LEADER
I20260923 19:36:51.051729 22774 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe9502b730049e6ad889b71face0adc" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46337 } }
I20260923 19:36:51.052511 22769 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:51.054694 22776 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbe9502b730049e6ad889b71face0adc. Latest consensus state: current_term: 1 leader_uuid: "fbe9502b730049e6ad889b71face0adc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe9502b730049e6ad889b71face0adc" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46337 } } }
I20260923 19:36:51.055135 22776 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:51.054738 22775 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbe9502b730049e6ad889b71face0adc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe9502b730049e6ad889b71face0adc" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46337 } } }
I20260923 19:36:51.055678 22775 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:51.058573 22781 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:51.063979 22781 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:51.073329 22781 catalog_manager.cc:1347] Generated new cluster ID: 4ccb4b572f64432cb2d4b07260bbee80
I20260923 19:36:51.073467 22781 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:51.093308 22781 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:51.093885 22781 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:51.102200 22781 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbe9502b730049e6ad889b71face0adc: Generated new TSK 0
I20260923 19:36:51.103132 22781 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:36:51.111131 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46337
--builtin_ntp_servers=127.12.159.212:36377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 19:36:51.444821 22793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:51.445115 22793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:51.445261 22793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:51.452584 22793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:51.452688 22793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:51.452845 22793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:51.462185 22793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:36377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:51.463531 22793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:51.465328 22793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:51.478672 22798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:51.478698 22801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:51.478912 22799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:51.479929 22793 server_base.cc:1034] running on GCE node
I20260923 19:36:51.480572 22793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:51.481567 22793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:51.482791 22793 hybrid_clock.cc:648] HybridClock initialized: now 1790192211482768 us; error 116 us; skew 500 ppm
I20260923 19:36:51.483176 22793 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:51.485504 22793 webserver.cc:460] Webserver started at http://127.12.159.193:39447/ using document root <none> and password file <none>
I20260923 19:36:51.486279 22793 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:51.486407 22793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:51.486722 22793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:51.489717 22793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "821cf591d1fc4330a90b86b162a19676"
format_stamp: "Formatted at 2026-09-23 19:36:51 on dist-test-slave-lzv7"
server_key: "018d9395e0e247f360de38491f44196e"
server_key_iv: "5b0c91b84eb25e08a0de6a6cce817cd8"
server_key_version: "encryptionkey@0"
I20260923 19:36:51.490667 22793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "821cf591d1fc4330a90b86b162a19676"
format_stamp: "Formatted at 2026-09-23 19:36:51 on dist-test-slave-lzv7"
server_key: "018d9395e0e247f360de38491f44196e"
server_key_iv: "5b0c91b84eb25e08a0de6a6cce817cd8"
server_key_version: "encryptionkey@0"
I20260923 19:36:51.495911 22793 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:36:51.499372 22807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:51.500737 22793 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260923 19:36:51.500939 22793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "821cf591d1fc4330a90b86b162a19676"
format_stamp: "Formatted at 2026-09-23 19:36:51 on dist-test-slave-lzv7"
server_key: "018d9395e0e247f360de38491f44196e"
server_key_iv: "5b0c91b84eb25e08a0de6a6cce817cd8"
server_key_version: "encryptionkey@0"
I20260923 19:36:51.501166 22793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:51.507579 22793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:51.508410 22793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:51.508688 22793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:51.509626 22793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:51.511199 22793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:51.511324 22793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:51.511459 22793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:51.511546 22793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:51.545746 22793 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:40017
I20260923 19:36:51.545886 22919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:40017 every 8 connection(s)
I20260923 19:36:51.547133 22793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:51.555308 22922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:51.549659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:48643 (local address 127.12.159.254:46337)
0923 19:36:51.550181 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:51.550186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:51.551245 (+ 1059us) server_negotiation.cc:407] Connection header received
0923 19:36:51.552960 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:51.552965 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:51.553041 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:51.553157 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:51.554537 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:51.554542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:51.554547 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:51.554564 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:51.554614 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:51.554625 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:51.554751 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:51.554947 (+ 196us) server_negotiation.cc:299] Negotiation successful
0923 19:36:51.555015 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":322,"threads_started":1}
I20260923 19:36:51.556361 22923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:51.550201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:46337 (local address 127.12.159.193:48643)
0923 19:36:51.551098 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:51.551132 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:51.552645 (+ 1513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:51.553396 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:51.553405 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:51.553495 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:51.554246 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:36:51.554249 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:51.554284 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:36:51.554376 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:51.554720 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:51.554731 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:51.554738 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 19:36:51.555030 (+ 292us) client_negotiation.cc:240] Negotiation successful
0923 19:36:51.555264 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":253,"threads_started":1}
I20260923 19:36:51.556486 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22793
I20260923 19:36:51.556689 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:36:51.557505 12927 external_mini_cluster.cc:1428] Setting key 2ba7b9bfcac86dd94af41263356e3344
I20260923 19:36:51.558219 22920 heartbeater.cc:347] Connected to a master server at 127.12.159.254:46337
I20260923 19:36:51.558537 22920 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:51.559211 22920 heartbeater.cc:511] Master 127.12.159.254:46337 requested a full tablet report, sending...
I20260923 19:36:51.560734 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46337
--builtin_ntp_servers=127.12.159.212:36377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260923 19:36:51.561496 22734 ts_manager.cc:194] Registered new tserver with Master: 821cf591d1fc4330a90b86b162a19676 (127.12.159.193:40017)
W20260923 19:36:51.885700 22924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:51.886076 22924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:51.886268 22924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:51.893844 22924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:51.893951 22924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:51.894129 22924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:51.904986 22924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:36377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:51.906569 22924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:51.908363 22924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:51.921574 22930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:51.921612 22932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:51.921650 22929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:51.922634 22924 server_base.cc:1034] running on GCE node
I20260923 19:36:51.923332 22924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:51.924420 22924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:51.925668 22924 hybrid_clock.cc:648] HybridClock initialized: now 1790192211925610 us; error 51 us; skew 500 ppm
I20260923 19:36:51.926091 22924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:51.928565 22924 webserver.cc:460] Webserver started at http://127.12.159.194:37019/ using document root <none> and password file <none>
I20260923 19:36:51.929324 22924 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:51.929467 22924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:51.929840 22924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:51.932806 22924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "a5bb8e17273e470180f692792ce78d2b"
format_stamp: "Formatted at 2026-09-23 19:36:51 on dist-test-slave-lzv7"
server_key: "9bce0279e2dee5ce1e7942af45d61cc5"
server_key_iv: "bcc7200e4f6a8e9bcc895c5ae980f3be"
server_key_version: "encryptionkey@0"
I20260923 19:36:51.933656 22924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "a5bb8e17273e470180f692792ce78d2b"
format_stamp: "Formatted at 2026-09-23 19:36:51 on dist-test-slave-lzv7"
server_key: "9bce0279e2dee5ce1e7942af45d61cc5"
server_key_iv: "bcc7200e4f6a8e9bcc895c5ae980f3be"
server_key_version: "encryptionkey@0"
I20260923 19:36:51.939234 22924 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:36:51.943249 22938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:51.944785 22924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:36:51.944993 22924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "a5bb8e17273e470180f692792ce78d2b"
format_stamp: "Formatted at 2026-09-23 19:36:51 on dist-test-slave-lzv7"
server_key: "9bce0279e2dee5ce1e7942af45d61cc5"
server_key_iv: "bcc7200e4f6a8e9bcc895c5ae980f3be"
server_key_version: "encryptionkey@0"
I20260923 19:36:51.945245 22924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:51.951082 22924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:51.951936 22924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:51.952399 22924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:51.953450 22924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:51.955006 22924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:51.955125 22924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:51.955257 22924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:51.955358 22924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:51.988313 22924 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:33623
I20260923 19:36:51.988371 23050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:33623 every 8 connection(s)
I20260923 19:36:51.989650 22924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:51.994266 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 22924
I20260923 19:36:51.994479 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:36:51.995081 12927 external_mini_cluster.cc:1428] Setting key b1e42853c8f4cfe4345368856ffc36ef
I20260923 19:36:51.998358 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46337
--builtin_ntp_servers=127.12.159.212:36377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260923 19:36:51.998896 22922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:51.992479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:51849 (local address 127.12.159.254:46337)
0923 19:36:51.992651 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:51.992655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:51.994222 (+ 1567us) server_negotiation.cc:407] Connection header received
0923 19:36:51.996366 (+ 2144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:51.996371 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:51.996438 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:51.996517 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:51.998079 (+ 1562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:51.998085 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:51.998092 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:51.998115 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:51.998155 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:51.998171 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:51.998287 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:51.998467 (+ 180us) server_negotiation.cc:299] Negotiation successful
0923 19:36:51.998546 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:36:51.999818 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:51.993014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:46337 (local address 127.12.159.194:51849)
0923 19:36:51.994001 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:51.994069 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:51.996046 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:51.996811 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:51.996828 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:51.996973 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:51.997740 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:36:51.997742 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:51.997779 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:36:51.997914 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:51.998274 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:51.998281 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:51.998286 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:36:51.998539 (+ 253us) client_negotiation.cc:240] Negotiation successful
0923 19:36:51.998815 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":270,"threads_started":1}
I20260923 19:36:52.001144 23051 heartbeater.cc:347] Connected to a master server at 127.12.159.254:46337
I20260923 19:36:52.001439 23051 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:52.002048 23051 heartbeater.cc:511] Master 127.12.159.254:46337 requested a full tablet report, sending...
I20260923 19:36:52.003417 22734 ts_manager.cc:194] Registered new tserver with Master: a5bb8e17273e470180f692792ce78d2b (127.12.159.194:33623)
W20260923 19:36:52.327239 23054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:52.327565 23054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:52.327725 23054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:52.335057 23054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:52.335188 23054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:52.335368 23054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:52.344452 23054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:36377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:52.345858 23054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:52.347646 23054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:52.361112 23059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:52.361174 23062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:52.361109 23060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:52.362038 23054 server_base.cc:1034] running on GCE node
I20260923 19:36:52.362658 23054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:52.363574 23054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:52.364796 23054 hybrid_clock.cc:648] HybridClock initialized: now 1790192212364753 us; error 55 us; skew 500 ppm
I20260923 19:36:52.365114 23054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:36:52.367368 23054 webserver.cc:460] Webserver started at http://127.12.159.195:33713/ using document root <none> and password file <none>
I20260923 19:36:52.368057 23054 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:52.368219 23054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:52.368561 23054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:52.371605 23054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "fed85a9ce27b49b4bc2091439c197460"
format_stamp: "Formatted at 2026-09-23 19:36:52 on dist-test-slave-lzv7"
server_key: "23af9f02d7f20e41ddd95116d10174a1"
server_key_iv: "753e2128a35f6f1841ff4785f4d55c39"
server_key_version: "encryptionkey@0"
I20260923 19:36:52.372442 23054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "fed85a9ce27b49b4bc2091439c197460"
format_stamp: "Formatted at 2026-09-23 19:36:52 on dist-test-slave-lzv7"
server_key: "23af9f02d7f20e41ddd95116d10174a1"
server_key_iv: "753e2128a35f6f1841ff4785f4d55c39"
server_key_version: "encryptionkey@0"
I20260923 19:36:52.377883 23054 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:36:52.381470 23068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:52.383220 23054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:36:52.383424 23054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "fed85a9ce27b49b4bc2091439c197460"
format_stamp: "Formatted at 2026-09-23 19:36:52 on dist-test-slave-lzv7"
server_key: "23af9f02d7f20e41ddd95116d10174a1"
server_key_iv: "753e2128a35f6f1841ff4785f4d55c39"
server_key_version: "encryptionkey@0"
I20260923 19:36:52.383673 23054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:52.389694 23054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:52.390604 23054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:52.390897 23054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:52.391819 23054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:52.393222 23054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:52.393347 23054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:52.393473 23054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:52.393561 23054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:52.427975 23054 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:34807
I20260923 19:36:52.428023 23180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:34807 every 8 connection(s)
I20260923 19:36:52.429311 23054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:52.431941 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 23054
I20260923 19:36:52.432161 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:36:52.432626 12927 external_mini_cluster.cc:1428] Setting key 0985b528fdd8246bf7f37b3cfb2b5e8b
I20260923 19:36:52.437851 22922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:52.431876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:45423 (local address 127.12.159.254:46337)
0923 19:36:52.432094 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:52.432099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:52.433708 (+ 1609us) server_negotiation.cc:407] Connection header received
0923 19:36:52.435614 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:52.435619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:52.435683 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:52.435793 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:52.437107 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:52.437112 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:52.437117 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:52.437135 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:52.437172 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:52.437183 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:52.437302 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:52.437501 (+ 199us) server_negotiation.cc:299] Negotiation successful
0923 19:36:52.437567 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260923 19:36:52.438730 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:52.432470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:46337 (local address 127.12.159.195:45423)
0923 19:36:52.433552 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:52.433597 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:52.435361 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:52.436043 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:52.436052 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:52.436143 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:52.436752 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:36:52.436754 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:52.436789 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:36:52.436867 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:52.437271 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:52.437283 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:52.437292 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 19:36:52.437578 (+ 286us) client_negotiation.cc:240] Negotiation successful
0923 19:36:52.437842 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":327,"threads_started":1}
I20260923 19:36:52.439872 23181 heartbeater.cc:347] Connected to a master server at 127.12.159.254:46337
I20260923 19:36:52.440168 23181 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:52.440750 23181 heartbeater.cc:511] Master 127.12.159.254:46337 requested a full tablet report, sending...
I20260923 19:36:52.442117 22734 ts_manager.cc:194] Registered new tserver with Master: fed85a9ce27b49b4bc2091439c197460 (127.12.159.195:34807)
I20260923 19:36:52.447813 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 19:36:52.454216 22922 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:36:52.452516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57430 (local address 127.12.159.254:46337)
0923 19:36:52.452683 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:52.452687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:52.453235 (+ 548us) server_negotiation.cc:407] Connection header received
0923 19:36:52.453445 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:52.453449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:52.453508 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:52.453606 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:52.453976 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57430: BlockingRecv error: recv got EOF from 127.0.0.1:57430 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:36:52.455152 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22793
I20260923 19:36:52.458580 23190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:52.456052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35774 (local address 127.12.159.193:40017)
0923 19:36:52.456528 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:52.456534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:52.456558 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:36:52.456612 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:52.456618 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:52.456811 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:52.456931 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:52.457909 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:52.457916 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:52.457927 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:52.457940 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:52.458019 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:52.458039 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:52.458144 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:52.458243 (+ 99us) server_negotiation.cc:299] Negotiation successful
0923 19:36:52.458322 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":219,"threads_started":1}
I20260923 19:36:52.459824 22915 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:52.543320 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22793
I20260923 19:36:52.560421 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22924
I20260923 19:36:52.564304 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:52.561428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43436 (local address 127.12.159.194:33623)
0923 19:36:52.562031 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:52.562039 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:52.562066 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:36:52.562130 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:52.562136 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:52.562356 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:52.562479 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:52.563521 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:52.563528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:52.563540 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:52.563560 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:52.563605 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:52.563619 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:52.563726 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:52.563885 (+ 159us) server_negotiation.cc:299] Negotiation successful
0923 19:36:52.563966 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":227,"threads_started":1}
I20260923 19:36:52.565625 23046 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:52.646802 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22924
I20260923 19:36:52.662649 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 23054
I20260923 19:36:52.666771 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:52.663595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.12.159.195:34807)
0923 19:36:52.664252 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:52.664258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:52.664289 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:36:52.664349 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:52.664356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:52.664606 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:52.664753 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:52.665901 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:52.665907 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:52.665918 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:36:52.665932 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:52.665980 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:36:52.666040 (+ 60us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:52.666180 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:52.666329 (+ 149us) server_negotiation.cc:299] Negotiation successful
0923 19:36:52.666443 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":319,"threads_started":1}
I20260923 19:36:52.668074 23176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:52.750206 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 23054
I20260923 19:36:52.766682 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 22703
I20260923 19:36:52.767839 22764 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:52.870756 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 22703
2026-09-23T19:36:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2351 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:36:52 dist-test-slave-lzv7 krb5kdc[23199](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:36:52 dist-test-slave-lzv7 krb5kdc[23199](info): set up 2 sockets
Sep 23 19:36:52 dist-test-slave-lzv7 krb5kdc[23199](info): commencing operation
krb5kdc: starting...
W20260923 19:36:53.982643 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:36:54 dist-test-slave-lzv7 krb5kdc[23199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:36:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:36:54.217873 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41357
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:41357
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:54.559151 23212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:54.559499 23212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:54.559674 23212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:54.566920 23212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:36:54.567065 23212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:54.567180 23212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:54.567353 23212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:36:54.567433 23212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:36:54.577288 23212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:41357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:54.578923 23212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:54.580327 23212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:54.592886 23220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:54.592913 23218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:54.592990 23217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:54.593855 23212 server_base.cc:1034] running on GCE node
I20260923 19:36:54.594758 23212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:54.596246 23212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:54.597479 23212 hybrid_clock.cc:648] HybridClock initialized: now 1790192214597434 us; error 45 us; skew 500 ppm
I20260923 19:36:54.597882 23212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:54 dist-test-slave-lzv7 krb5kdc[23199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192214, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:54.605486 23212 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:36:54.607055 23212 webserver.cc:460] Webserver started at http://127.12.159.254:43463/ using document root <none> and password file <none>
I20260923 19:36:54.607728 23212 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:54.607828 23212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:54.608112 23212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:54.611292 23212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "c0f2fa8528e846b5be48cd8b32945ab0"
format_stamp: "Formatted at 2026-09-23 19:36:54 on dist-test-slave-lzv7"
server_key: "4af89ffc18eca6dba6b12cfdc0fe476d"
server_key_iv: "1218619e125a3af03601ba1a0f33f5f5"
server_key_version: "encryptionkey@0"
I20260923 19:36:54.612003 23212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "c0f2fa8528e846b5be48cd8b32945ab0"
format_stamp: "Formatted at 2026-09-23 19:36:54 on dist-test-slave-lzv7"
server_key: "4af89ffc18eca6dba6b12cfdc0fe476d"
server_key_iv: "1218619e125a3af03601ba1a0f33f5f5"
server_key_version: "encryptionkey@0"
I20260923 19:36:54.617264 23212 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:36:54.620966 23227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:54.622476 23212 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:54.622673 23212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "c0f2fa8528e846b5be48cd8b32945ab0"
format_stamp: "Formatted at 2026-09-23 19:36:54 on dist-test-slave-lzv7"
server_key: "4af89ffc18eca6dba6b12cfdc0fe476d"
server_key_iv: "1218619e125a3af03601ba1a0f33f5f5"
server_key_version: "encryptionkey@0"
I20260923 19:36:54.622854 23212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:54.653447 23212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:54.657925 23212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:54.658227 23212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:54.676836 23212 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:41357
I20260923 19:36:54.676878 23278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:41357 every 8 connection(s)
I20260923 19:36:54.678259 23212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:36:54.680374 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 23212
I20260923 19:36:54.680608 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:36:54.681258 12927 external_mini_cluster.cc:1428] Setting key 60d2b5d632c68cf18c9b06d7ead46d47
I20260923 19:36:54.682529 23279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:36:54 dist-test-slave-lzv7 krb5kdc[23199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:54.697084 23279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0: Bootstrap starting.
I20260923 19:36:54.700572 23279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:54.701869 23279 log.cc:824] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:54.704380 23282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:54.683392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51960 (local address 127.12.159.254:41357)
0923 19:36:54.684203 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:54.684215 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:54.684258 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:36:54.685760 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:54.685782 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:54.686250 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:54.686591 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:54.688420 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:54.689687 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:54.691440 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:54.692080 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:54.692209 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:54.696921 (+ 4712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:54.696929 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:54.696942 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:54.696977 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:54.699980 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:54.700803 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:54.700811 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:54.700819 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:54.701024 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:54.701406 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:54.701409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:54.701411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:54.701973 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:54.702277 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:54.702773 (+ 496us) server_negotiation.cc:299] Negotiation successful
0923 19:36:54.703265 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":372,"threads_started":1}
I20260923 19:36:54.705158 23279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0: No bootstrap required, opened a new log
I20260923 19:36:54.713510 23279 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41357 } }
I20260923 19:36:54.713954 23279 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:54.714085 23279 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f2fa8528e846b5be48cd8b32945ab0, State: Initialized, Role: FOLLOWER
I20260923 19:36:54.714638 23279 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41357 } }
I20260923 19:36:54.714883 23279 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:36:54.715032 23279 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:36:54.715205 23279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:54.717622 23279 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41357 } }
I20260923 19:36:54.718173 23279 leader_election.cc:302] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0f2fa8528e846b5be48cd8b32945ab0; no voters:
I20260923 19:36:54.718712 23279 leader_election.cc:288] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:36:54.718817 23284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:54.720363 23284 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [term 1 LEADER]: Becoming Leader. State: Replica: c0f2fa8528e846b5be48cd8b32945ab0, State: Running, Role: LEADER
I20260923 19:36:54.720862 23284 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41357 } }
I20260923 19:36:54.721215 23279 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:36:54.724411 23285 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41357 } } }
I20260923 19:36:54.724781 23285 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:54.725253 23286 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0f2fa8528e846b5be48cd8b32945ab0. Latest consensus state: current_term: 1 leader_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0f2fa8528e846b5be48cd8b32945ab0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41357 } } }
I20260923 19:36:54.725577 23286 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:36:54.726828 23293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:36:54.733367 23293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:36:54.743929 23293 catalog_manager.cc:1347] Generated new cluster ID: 5b1590ac73fd40cfad5ea1db2c2fce4f
I20260923 19:36:54.744073 23293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:36:54.758328 23293 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:36:54.760262 23293 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:36:54.769779 23293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0: Generated new TSK 0
I20260923 19:36:54.770874 23293 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:36:54.830149 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41357
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:55.166671 23305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:55.167008 23305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:55.167176 23305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:55.174410 23305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:55.174557 23305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:55.174737 23305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:36:55.184630 23305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:55.186039 23305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:55.187276 23305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:55.200251 23310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:55.200208 23311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:55.200389 23313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:55.201104 23305 server_base.cc:1034] running on GCE node
I20260923 19:36:55.201740 23305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:55.202746 23305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:55.204041 23305 hybrid_clock.cc:648] HybridClock initialized: now 1790192215203942 us; error 58 us; skew 500 ppm
I20260923 19:36:55.204456 23305 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:55 dist-test-slave-lzv7 krb5kdc[23199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192215, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:55.208070 23305 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:36:55.209596 23305 webserver.cc:460] Webserver started at http://127.12.159.193:33395/ using document root <none> and password file <none>
I20260923 19:36:55.210378 23305 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:55.210492 23305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:55.210750 23305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:55.213766 23305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "cf1a272859a644f4aafec5b88fed59b7"
format_stamp: "Formatted at 2026-09-23 19:36:55 on dist-test-slave-lzv7"
server_key: "40d9e3a9058cdb0871228a6b2a0317f6"
server_key_iv: "5d6ff10034c323aa00cb712edc395d29"
server_key_version: "encryptionkey@0"
I20260923 19:36:55.214707 23305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "cf1a272859a644f4aafec5b88fed59b7"
format_stamp: "Formatted at 2026-09-23 19:36:55 on dist-test-slave-lzv7"
server_key: "40d9e3a9058cdb0871228a6b2a0317f6"
server_key_iv: "5d6ff10034c323aa00cb712edc395d29"
server_key_version: "encryptionkey@0"
I20260923 19:36:55.220639 23305 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260923 19:36:55.224511 23320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:55.226163 23305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:36:55.226311 23305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "cf1a272859a644f4aafec5b88fed59b7"
format_stamp: "Formatted at 2026-09-23 19:36:55 on dist-test-slave-lzv7"
server_key: "40d9e3a9058cdb0871228a6b2a0317f6"
server_key_iv: "5d6ff10034c323aa00cb712edc395d29"
server_key_version: "encryptionkey@0"
I20260923 19:36:55.226577 23305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:55.270305 23305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:55.274864 23305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:55.275188 23305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:55.276193 23305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:55.277467 23305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:55.277541 23305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:55.277621 23305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:55.277664 23305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:55.311729 23305 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:44049
I20260923 19:36:55.311810 23432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:44049 every 8 connection(s)
I20260923 19:36:55.313202 23305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:36:55.316619 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 23305
I20260923 19:36:55.316864 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:36:55.317598 12927 external_mini_cluster.cc:1428] Setting key 6af3c9832fa6f1225b08a04100293ddc
Sep 23 19:36:55 dist-test-slave-lzv7 krb5kdc[23199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192215, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:55.335884 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:55.315989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:41157 (local address 127.12.159.254:41357)
0923 19:36:55.316456 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:55.316463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:55.317425 (+ 962us) server_negotiation.cc:407] Connection header received
0923 19:36:55.319543 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:55.319550 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:55.319627 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:55.319735 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:55.321326 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.322543 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.324128 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.324849 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.324995 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:55.329350 (+ 4355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:55.329355 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:55.329358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:55.329389 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:55.332269 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:55.333345 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:55.333349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:55.333352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:55.333465 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:55.334048 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:55.334052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:55.334054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:55.334351 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:55.334494 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:55.335464 (+ 970us) server_negotiation.cc:299] Negotiation successful
0923 19:36:55.335635 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":1859,"threads_started":1}
I20260923 19:36:55.337668 23436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:55.316406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41357 (local address 127.12.159.193:41157)
0923 19:36:55.317239 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:55.317290 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:55.319225 (+ 1935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:55.319939 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:55.319947 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:55.320474 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:55.321156 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:55.321176 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.322724 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.322728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:55.323974 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:55.323985 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.325101 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.325107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:55.325339 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:55.326201 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:55.326226 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:55.329078 (+ 2852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:55.332472 (+ 3394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:55.332485 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:55.332505 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:55.333175 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:55.333580 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:55.333588 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:55.333595 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:55.333888 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:55.334497 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:55.334508 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:55.335005 (+ 497us) client_negotiation.cc:769] Sending connection context
0923 19:36:55.335357 (+ 352us) client_negotiation.cc:240] Negotiation successful
0923 19:36:55.335958 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":340,"threads_started":1}
I20260923 19:36:55.339502 23433 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41357
I20260923 19:36:55.339813 23433 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:55.340557 23433 heartbeater.cc:511] Master 127.12.159.254:41357 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:36:55.342746 23244 ts_manager.cc:194] Registered new tserver with Master: cf1a272859a644f4aafec5b88fed59b7 (127.12.159.193:44049)
I20260923 19:36:55.344221 23244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:41157
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:36:55.374462 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41357
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:55.699496 23439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:55.699807 23439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:55.699973 23439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:55.707391 23439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:55.707553 23439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:55.707728 23439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:36:55.717630 23439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:55.719002 23439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:55.720283 23439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:55.734046 23444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:55.734082 23447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:55.734030 23445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:55.734946 23439 server_base.cc:1034] running on GCE node
I20260923 19:36:55.735522 23439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:55.736550 23439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:55.737798 23439 hybrid_clock.cc:648] HybridClock initialized: now 1790192215737749 us; error 44 us; skew 500 ppm
I20260923 19:36:55.738215 23439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:55 dist-test-slave-lzv7 krb5kdc[23199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192215, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:55.741513 23439 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:36:55.743101 23439 webserver.cc:460] Webserver started at http://127.12.159.194:43409/ using document root <none> and password file <none>
I20260923 19:36:55.743772 23439 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:55.743873 23439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:55.744123 23439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:55.747102 23439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "e6b353df4ecd452a8e63a1fa890ae3ff"
format_stamp: "Formatted at 2026-09-23 19:36:55 on dist-test-slave-lzv7"
server_key: "e2e9996173d549d64ca4ead3714c1b0d"
server_key_iv: "de2b8ed8cac2fad84075cd2acf74c046"
server_key_version: "encryptionkey@0"
I20260923 19:36:55.747856 23439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "e6b353df4ecd452a8e63a1fa890ae3ff"
format_stamp: "Formatted at 2026-09-23 19:36:55 on dist-test-slave-lzv7"
server_key: "e2e9996173d549d64ca4ead3714c1b0d"
server_key_iv: "de2b8ed8cac2fad84075cd2acf74c046"
server_key_version: "encryptionkey@0"
I20260923 19:36:55.753046 23439 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260923 19:36:55.756596 23454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:55.758122 23439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:36:55.758294 23439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "e6b353df4ecd452a8e63a1fa890ae3ff"
format_stamp: "Formatted at 2026-09-23 19:36:55 on dist-test-slave-lzv7"
server_key: "e2e9996173d549d64ca4ead3714c1b0d"
server_key_iv: "de2b8ed8cac2fad84075cd2acf74c046"
server_key_version: "encryptionkey@0"
I20260923 19:36:55.758473 23439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:55.771245 23439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:55.775696 23439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:55.775957 23439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:55.776898 23439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:55.778280 23439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:55.778353 23439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:55.778445 23439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:55.778492 23439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:55.813511 23439 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:43969
I20260923 19:36:55.813552 23566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:43969 every 8 connection(s)
I20260923 19:36:55.814915 23439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:36:55.816797 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 23439
I20260923 19:36:55.817013 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:36:55.817559 12927 external_mini_cluster.cc:1428] Setting key c8c3b34b59ff63fc668ec0f95b663127
Sep 23 19:36:55 dist-test-slave-lzv7 krb5kdc[23199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192215, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:55.839031 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:55.818281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:42685 (local address 127.12.159.254:41357)
0923 19:36:55.818517 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:55.818522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:55.819911 (+ 1389us) server_negotiation.cc:407] Connection header received
0923 19:36:55.822114 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:55.822122 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:55.822220 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:55.822369 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:55.823955 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.825170 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.827110 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.827664 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.827801 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:55.831585 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:55.831594 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:55.831602 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:55.831649 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:55.835348 (+ 3699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:55.836235 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:55.836243 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:55.836250 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:55.836428 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:55.836885 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:55.836893 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:55.836896 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:55.837283 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:55.837479 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:55.838291 (+ 812us) server_negotiation.cc:299] Negotiation successful
0923 19:36:55.838578 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:36:55.839849 23569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:55.818887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41357 (local address 127.12.159.194:42685)
0923 19:36:55.819727 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:55.819774 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:55.821769 (+ 1995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:55.822569 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:55.822578 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:55.823169 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:55.823755 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:55.823773 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.825332 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.825336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:55.826949 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:55.826966 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:55.827908 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:55.827922 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:55.828180 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:55.828910 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:55.828932 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:55.831326 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:55.835533 (+ 4207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:55.835541 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:55.835555 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:55.836086 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:55.836564 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:55.836567 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:55.836570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:55.836756 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:55.837420 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:55.837426 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:55.837796 (+ 370us) client_negotiation.cc:769] Sending connection context
0923 19:36:55.838111 (+ 315us) client_negotiation.cc:240] Negotiation successful
0923 19:36:55.838530 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":361,"threads_started":1}
I20260923 19:36:55.841408 23567 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41357
I20260923 19:36:55.841734 23567 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:36:55.842540 23567 heartbeater.cc:511] Master 127.12.159.254:41357 requested a full tablet report, sending...
I20260923 19:36:55.844111 23244 ts_manager.cc:194] Registered new tserver with Master: e6b353df4ecd452a8e63a1fa890ae3ff (127.12.159.194:43969)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
I20260923 19:36:55.845060 23244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:42685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:36:55.874369 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41357
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:34565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:36:56.224071 23572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:36:56.224541 23572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:36:56.224735 23572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:36:56.234534 23572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:36:56.234651 23572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:36:56.234766 23572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:36:56.244757 23572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:34565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:36:56.246125 23572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:36:56.247375 23572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:36:56.260346 23580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:56.260623 23578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:36:56.260557 23577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:36:56.261940 23572 server_base.cc:1034] running on GCE node
I20260923 19:36:56.262615 23572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:36:56.263703 23572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:36:56.264943 23572 hybrid_clock.cc:648] HybridClock initialized: now 1790192216264891 us; error 46 us; skew 500 ppm
I20260923 19:36:56.265301 23572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:36:56 dist-test-slave-lzv7 krb5kdc[23199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192216, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:36:56.268814 23572 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:36:56.270473 23572 webserver.cc:460] Webserver started at http://127.12.159.195:35105/ using document root <none> and password file <none>
I20260923 19:36:56.271174 23572 fs_manager.cc:359] Metadata directory not provided
I20260923 19:36:56.271317 23572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:36:56.271646 23572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:36:56.274537 23572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "e4b2fc1501214f55b40c9deff62e5dab"
format_stamp: "Formatted at 2026-09-23 19:36:56 on dist-test-slave-lzv7"
server_key: "ac8376a88349d194b9d548d3e8acd68a"
server_key_iv: "a8e6b41c7dd9e0e43f94788505d850cf"
server_key_version: "encryptionkey@0"
I20260923 19:36:56.275308 23572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "e4b2fc1501214f55b40c9deff62e5dab"
format_stamp: "Formatted at 2026-09-23 19:36:56 on dist-test-slave-lzv7"
server_key: "ac8376a88349d194b9d548d3e8acd68a"
server_key_iv: "a8e6b41c7dd9e0e43f94788505d850cf"
server_key_version: "encryptionkey@0"
I20260923 19:36:56.280380 23572 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:36:56.283946 23587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:56.285359 23572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:36:56.285565 23572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "e4b2fc1501214f55b40c9deff62e5dab"
format_stamp: "Formatted at 2026-09-23 19:36:56 on dist-test-slave-lzv7"
server_key: "ac8376a88349d194b9d548d3e8acd68a"
server_key_iv: "a8e6b41c7dd9e0e43f94788505d850cf"
server_key_version: "encryptionkey@0"
I20260923 19:36:56.285782 23572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:36:56.316903 23572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:36:56.321470 23572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:36:56.321957 23572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:36:56.322978 23572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:36:56.324345 23572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:36:56.324451 23572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:56.324612 23572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:36:56.324693 23572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:36:56.347558 23433 heartbeater.cc:503] Master 127.12.159.254:41357 was elected leader, sending a full tablet report...
I20260923 19:36:56.359784 23572 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:35195
I20260923 19:36:56.359833 23699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:35195 every 8 connection(s)
I20260923 19:36:56.361179 23572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:36:56.367576 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 23572
I20260923 19:36:56.367784 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:36:56.368209 12927 external_mini_cluster.cc:1428] Setting key 86a95c82a963fbbe93ff62f9c286fca0
Sep 23 19:36:56 dist-test-slave-lzv7 krb5kdc[23199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192216, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:36:56.381487 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.363808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:39291 (local address 127.12.159.254:41357)
0923 19:36:56.364313 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.364318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.365115 (+ 797us) server_negotiation.cc:407] Connection header received
0923 19:36:56.367031 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.367038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.367127 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.367275 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:56.368948 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.370114 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.372042 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.372425 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.372525 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.375989 (+ 3464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:56.375994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:56.375998 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:56.376030 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:56.378799 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.379462 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.379465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.379467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.379627 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.379992 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.379995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.379997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.380240 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:56.380348 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.381005 (+ 657us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.381175 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":299,"threads_started":1}
I20260923 19:36:56.382589 23703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.364291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41357 (local address 127.12.159.195:39291)
0923 19:36:56.364950 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:56.364993 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:56.366748 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:56.367505 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:56.367513 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:56.368094 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:36:56.368757 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.368782 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.370291 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.370300 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.371914 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.371926 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.372647 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.372652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.372846 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.373502 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:36:56.373561 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:36:56.375791 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:36:56.378943 (+ 3152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:56.378949 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:56.378962 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:56.379360 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:56.379720 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:36:56.379723 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:36:56.379725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:36:56.379902 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:36:56.380341 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:36:56.380347 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:36:56.380696 (+ 349us) client_negotiation.cc:769] Sending connection context
0923 19:36:56.380920 (+ 224us) client_negotiation.cc:240] Negotiation successful
0923 19:36:56.381316 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":268,"threads_started":1}
I20260923 19:36:56.384100 23700 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41357
I20260923 19:36:56.384407 23700 heartbeater.cc:464] Registering TS with master...
I20260923 19:36:56.385128 23700 heartbeater.cc:511] Master 127.12.159.254:41357 requested a full tablet report, sending...
I20260923 19:36:56.386540 23244 ts_manager.cc:194] Registered new tserver with Master: e4b2fc1501214f55b40c9deff62e5dab (127.12.159.195:35195)
I20260923 19:36:56.387315 23244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:39291
I20260923 19:36:56.396236 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:36:56.414094 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.401094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51968 (local address 127.12.159.254:41357)
0923 19:36:56.401276 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.401280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.401996 (+ 716us) server_negotiation.cc:407] Connection header received
0923 19:36:56.402144 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.402148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.402225 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.402312 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:56.403723 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.404541 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.405885 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.406301 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.406409 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.408681 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:56.408686 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:56.408689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:56.408730 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:56.411553 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.412204 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.412207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.412210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.412323 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.412676 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.412680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.412682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.413027 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:56.413204 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.413576 (+ 372us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.413786 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:36:56.418509 23244 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:36:56.425567 23244 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:36:56.450893 23717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.441207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:44049 (local address 127.0.0.1:54864)
0923 19:36:56.442474 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:56.442495 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:56.442664 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:56.443309 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:56.443314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:56.443338 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:56.443753 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.443766 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.445214 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.445220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.447341 (+ 2121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.447358 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.449550 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.449559 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.449822 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.449929 (+ 107us) client_negotiation.cc:769] Sending connection context
0923 19:36:56.450101 (+ 172us) client_negotiation.cc:240] Negotiation successful
0923 19:36:56.450357 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"mutex_wait_us":3,"thread_start_us":290,"threads_started":1}
I20260923 19:36:56.452015 23718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.441535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54864 (local address 127.12.159.193:44049)
0923 19:36:56.442360 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.442369 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.442746 (+ 377us) server_negotiation.cc:407] Connection header received
0923 19:36:56.442843 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.442850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.443108 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.443299 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:56.443964 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.445075 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.447512 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.448879 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.449115 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.449399 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.451350 (+ 1951us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.451563 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":410,"threads_started":1}
I20260923 19:36:56.457391 23368 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6db824f91641f49b7bd45253610b11 (DEFAULT_TABLE table=test-table [id=47b2129047a04b1fb4b0f4f2cbf9a28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:56.459323 23368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6db824f91641f49b7bd45253610b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:56.460017 23716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.438340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43969 (local address 127.0.0.1:39492)
0923 19:36:56.440610 (+ 2270us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:56.440658 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:56.440867 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:56.441738 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:56.441745 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:56.441776 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:56.442605 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.442620 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.444287 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.444294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.446894 (+ 2600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.446923 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.459171 (+ 12248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.459178 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.459376 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.459418 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 19:36:56.459488 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 19:36:56.459632 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1995,"mutex_wait_us":24,"thread_start_us":2284,"threads_started":1}
I20260923 19:36:56.461135 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.438559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.12.159.194:43969)
0923 19:36:56.440051 (+ 1492us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.440063 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.441022 (+ 959us) server_negotiation.cc:407] Connection header received
0923 19:36:56.441139 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.441146 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.441466 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.441726 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:56.442810 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.444180 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.456202 (+ 12022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.458915 (+ 2713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.460280 (+ 1365us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.460435 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.460510 (+ 75us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.460714 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1286,"thread_start_us":1154,"threads_started":1}
I20260923 19:36:56.463346 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.439624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60786 (local address 127.12.159.195:35195)
0923 19:36:56.440385 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.440393 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.440970 (+ 577us) server_negotiation.cc:407] Connection header received
0923 19:36:56.442971 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.442977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.443156 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.443317 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:56.444229 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.445906 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.448319 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.459144 (+ 10825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.459329 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.459522 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.462532 (+ 3010us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.462780 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":410,"threads_started":1}
I20260923 19:36:56.464233 23713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.439037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:35195 (local address 127.0.0.1:60786)
0923 19:36:56.440867 (+ 1830us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:56.440884 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:56.441109 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:56.443660 (+ 2551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:56.443666 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:56.443698 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:56.444074 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.444082 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.446078 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.446084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.448139 (+ 2055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.448153 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.461998 (+ 13845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.462007 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.462247 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.462323 (+ 76us) client_negotiation.cc:769] Sending connection context
0923 19:36:56.463552 (+ 1229us) client_negotiation.cc:240] Negotiation successful
0923 19:36:56.463748 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1714,"mutex_wait_us":49,"thread_start_us":1234,"threads_started":1}
I20260923 19:36:56.465008 23502 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6db824f91641f49b7bd45253610b11 (DEFAULT_TABLE table=test-table [id=47b2129047a04b1fb4b0f4f2cbf9a28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:56.468917 23635 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6db824f91641f49b7bd45253610b11 (DEFAULT_TABLE table=test-table [id=47b2129047a04b1fb4b0f4f2cbf9a28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:36:56.471444 23635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6db824f91641f49b7bd45253610b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:56.473762 23719 tablet_bootstrap.cc:492] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Bootstrap starting.
I20260923 19:36:56.474567 23502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b6db824f91641f49b7bd45253610b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:36:56.477486 23719 tablet_bootstrap.cc:654] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:56.479168 23719 log.cc:824] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:56.482160 23719 tablet_bootstrap.cc:492] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: No bootstrap required, opened a new log
I20260923 19:36:56.482589 23719 ts_tablet_manager.cc:1397] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260923 19:36:56.494315 23719 raft_consensus.cc:348] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.494972 23719 raft_consensus.cc:374] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:56.495141 23719 raft_consensus.cc:729] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf1a272859a644f4aafec5b88fed59b7, State: Initialized, Role: FOLLOWER
I20260923 19:36:56.495998 23719 consensus_queue.cc:260] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.496201 23721 tablet_bootstrap.cc:492] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Bootstrap starting.
I20260923 19:36:56.500818 23721 tablet_bootstrap.cc:654] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:56.500922 23722 tablet_bootstrap.cc:492] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Bootstrap starting.
I20260923 19:36:56.502554 23721 log.cc:824] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:56.506497 23722 tablet_bootstrap.cc:654] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Neither blocks nor log segments found. Creating new log.
I20260923 19:36:56.507934 23722 log.cc:824] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Log is configured to *not* fsync() on all Append() calls
I20260923 19:36:56.512147 23721 tablet_bootstrap.cc:492] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: No bootstrap required, opened a new log
I20260923 19:36:56.512488 23721 ts_tablet_manager.cc:1397] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.005s
I20260923 19:36:56.513473 23719 ts_tablet_manager.cc:1428] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Time spent starting tablet: real 0.031s user 0.016s sys 0.004s
I20260923 19:36:56.521320 23722 tablet_bootstrap.cc:492] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: No bootstrap required, opened a new log
I20260923 19:36:56.521699 23722 ts_tablet_manager.cc:1397] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.005s
I20260923 19:36:56.521683 23721 raft_consensus.cc:348] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.522362 23721 raft_consensus.cc:374] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:56.522496 23721 raft_consensus.cc:729] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b353df4ecd452a8e63a1fa890ae3ff, State: Initialized, Role: FOLLOWER
I20260923 19:36:56.523339 23721 consensus_queue.cc:260] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.525672 23567 heartbeater.cc:503] Master 127.12.159.254:41357 was elected leader, sending a full tablet report...
I20260923 19:36:56.526356 23721 ts_tablet_manager.cc:1428] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260923 19:36:56.537585 23722 raft_consensus.cc:348] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.538200 23722 raft_consensus.cc:374] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:36:56.538340 23722 raft_consensus.cc:729] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b2fc1501214f55b40c9deff62e5dab, State: Initialized, Role: FOLLOWER
I20260923 19:36:56.539096 23722 consensus_queue.cc:260] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.540282 23700 heartbeater.cc:503] Master 127.12.159.254:41357 was elected leader, sending a full tablet report...
I20260923 19:36:56.541141 23722 ts_tablet_manager.cc:1428] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Time spent starting tablet: real 0.019s user 0.013s sys 0.003s
W20260923 19:36:56.565850 23434 tablet.cc:2369] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:36:56.567061 23568 tablet.cc:2369] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:36:56.599730 23723 raft_consensus.cc:482] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:36:56.600054 23723 raft_consensus.cc:504] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.601850 23723 leader_election.cc:288] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b353df4ecd452a8e63a1fa890ae3ff (127.12.159.194:43969), e4b2fc1501214f55b40c9deff62e5dab (127.12.159.195:35195)
I20260923 19:36:56.610471 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.602363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:35195 (local address 127.12.159.193:58805)
0923 19:36:56.603443 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:56.603460 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:56.603620 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:56.604053 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:56.604061 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:56.604097 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:56.604584 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.604599 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.606479 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.606484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.608310 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.608323 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.609504 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.609509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.609697 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.609742 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 19:36:56.609929 (+ 187us) client_negotiation.cc:240] Negotiation successful
0923 19:36:56.610081 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"mutex_wait_us":23,"thread_start_us":430,"threads_started":1}
I20260923 19:36:56.610535 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.602821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:60105 (local address 127.12.159.194:43969)
0923 19:36:56.603053 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.603061 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.603270 (+ 209us) server_negotiation.cc:407] Connection header received
0923 19:36:56.603606 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.603614 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.603711 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.603825 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:56.604605 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.605607 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.607961 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.609530 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.609693 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.609798 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.610138 (+ 340us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.610279 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:36:56.610524 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.602373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:58805 (local address 127.12.159.195:35195)
0923 19:36:56.602624 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.602633 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.603530 (+ 897us) server_negotiation.cc:407] Connection header received
0923 19:36:56.603760 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.603764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.603857 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.603946 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:36:56.604797 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.606305 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.608486 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.609290 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.609495 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.609570 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.609991 (+ 421us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.610180 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260923 19:36:56.611204 23729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.602218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43969 (local address 127.12.159.193:60105)
0923 19:36:56.603141 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0923 19:36:56.603163 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:36:56.603398 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:36:56.603848 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:36:56.603852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:36:56.603876 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:36:56.604400 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.604419 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.605710 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.605717 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.607775 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:36:56.607790 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.609744 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.609749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:36:56.609966 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.609994 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 19:36:56.610693 (+ 699us) client_negotiation.cc:240] Negotiation successful
0923 19:36:56.610827 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"mutex_wait_us":7,"thread_start_us":915,"threads_started":1}
I20260923 19:36:56.611968 23655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6db824f91641f49b7bd45253610b11" candidate_uuid: "cf1a272859a644f4aafec5b88fed59b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b2fc1501214f55b40c9deff62e5dab" is_pre_election: true
I20260923 19:36:56.612174 23522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6db824f91641f49b7bd45253610b11" candidate_uuid: "cf1a272859a644f4aafec5b88fed59b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" is_pre_election: true
I20260923 19:36:56.612673 23655 raft_consensus.cc:2454] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf1a272859a644f4aafec5b88fed59b7 in term 0.
I20260923 19:36:56.612699 23522 raft_consensus.cc:2454] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf1a272859a644f4aafec5b88fed59b7 in term 0.
W20260923 19:36:56.612903 23701 tablet.cc:2369] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:36:56.613477 23323 leader_election.cc:302] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf1a272859a644f4aafec5b88fed59b7, e6b353df4ecd452a8e63a1fa890ae3ff; no voters:
I20260923 19:36:56.613947 23723 raft_consensus.cc:2781] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:36:56.614097 23723 raft_consensus.cc:482] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:36:56.614207 23723 raft_consensus.cc:3037] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:56.616330 23723 raft_consensus.cc:504] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.616981 23723 leader_election.cc:288] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [CANDIDATE]: Term 1 election: Requested vote from peers e6b353df4ecd452a8e63a1fa890ae3ff (127.12.159.194:43969), e4b2fc1501214f55b40c9deff62e5dab (127.12.159.195:35195)
I20260923 19:36:56.617414 23522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6db824f91641f49b7bd45253610b11" candidate_uuid: "cf1a272859a644f4aafec5b88fed59b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff"
I20260923 19:36:56.617560 23655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6db824f91641f49b7bd45253610b11" candidate_uuid: "cf1a272859a644f4aafec5b88fed59b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b2fc1501214f55b40c9deff62e5dab"
I20260923 19:36:56.617632 23522 raft_consensus.cc:3037] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:56.617784 23655 raft_consensus.cc:3037] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:36:56.620920 23522 raft_consensus.cc:2454] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf1a272859a644f4aafec5b88fed59b7 in term 1.
I20260923 19:36:56.621075 23655 raft_consensus.cc:2454] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf1a272859a644f4aafec5b88fed59b7 in term 1.
I20260923 19:36:56.621455 23323 leader_election.cc:302] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf1a272859a644f4aafec5b88fed59b7, e6b353df4ecd452a8e63a1fa890ae3ff; no voters:
I20260923 19:36:56.621789 23723 raft_consensus.cc:2781] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:36:56.622367 23723 raft_consensus.cc:686] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 1 LEADER]: Becoming Leader. State: Replica: cf1a272859a644f4aafec5b88fed59b7, State: Running, Role: LEADER
I20260923 19:36:56.622975 23723 consensus_queue.cc:237] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } }
I20260923 19:36:56.628153 23243 catalog_manager.cc:5495] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf1a272859a644f4aafec5b88fed59b7 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "cf1a272859a644f4aafec5b88fed59b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf1a272859a644f4aafec5b88fed59b7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 44049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 } health_report { overall_health: UNKNOWN } } }
I20260923 19:36:56.654961 23718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.649179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54878 (local address 127.12.159.193:44049)
0923 19:36:56.649406 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.649413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.649638 (+ 225us) server_negotiation.cc:407] Connection header received
0923 19:36:56.649902 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.649913 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.650002 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.650169 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:36:56.650531 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.651311 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.652637 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.653041 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.653185 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.653681 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:36:56.654373 (+ 692us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:36:56.654529 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.654616 (+ 87us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.654696 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:36:56.665405 23655 raft_consensus.cc:1261] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 1 FOLLOWER]: Refusing update from remote peer cf1a272859a644f4aafec5b88fed59b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:56.665580 23522 raft_consensus.cc:1261] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 1 FOLLOWER]: Refusing update from remote peer cf1a272859a644f4aafec5b88fed59b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:36:56.666502 23730 consensus_queue.cc:1035] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b353df4ecd452a8e63a1fa890ae3ff" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:56.667241 23723 consensus_queue.cc:1035] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b2fc1501214f55b40c9deff62e5dab" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 35195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:36:56.684558 23733 mvcc.cc:205] Tried to move back new op lower bound from 7332627319450583040 to 7332627319291080704. Current Snapshot: MvccSnapshot[applied={T|T < 7332627319450583040}]
I20260923 19:36:56.685019 23734 mvcc.cc:205] Tried to move back new op lower bound from 7332627319450583040 to 7332627319291080704. Current Snapshot: MvccSnapshot[applied={T|T < 7332627319450583040}]
I20260923 19:36:56.699435 23243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:56.699739 23243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:36:56.703874 23243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0f2fa8528e846b5be48cd8b32945ab0: Sending DeleteTablet for 3 replicas of tablet 6b6db824f91641f49b7bd45253610b11
I20260923 19:36:56.705114 23635 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6db824f91641f49b7bd45253610b11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:56 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:60786
I20260923 19:36:56.705852 23502 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6db824f91641f49b7bd45253610b11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:56 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:39492
I20260923 19:36:56.707537 23368 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b6db824f91641f49b7bd45253610b11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:36:56 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:54864
I20260923 19:36:56.729712 23744 tablet_replica.cc:330] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: stopping tablet replica
I20260923 19:36:56.730041 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 23305
I20260923 19:36:56.730346 23744 raft_consensus.cc:2229] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:36:56.731114 23744 raft_consensus.cc:2258] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:56.731943 23743 tablet_replica.cc:330] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: stopping tablet replica
I20260923 19:36:56.732405 23743 raft_consensus.cc:2229] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:56.733007 23743 raft_consensus.cc:2258] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:56.733917 23742 tablet_replica.cc:330] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: stopping tablet replica
I20260923 19:36:56.734395 23742 raft_consensus.cc:2229] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:36:56.734929 23742 raft_consensus.cc:2258] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:36:56.737831 23743 ts_tablet_manager.cc:1905] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:56.741225 23744 ts_tablet_manager.cc:1905] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:56.746833 23743 ts_tablet_manager.cc:1918] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:56.747013 23743 log.cc:1196] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/6b6db824f91641f49b7bd45253610b11
I20260923 19:36:56.747584 23743 ts_tablet_manager.cc:1939] T 6b6db824f91641f49b7bd45253610b11 P e6b353df4ecd452a8e63a1fa890ae3ff: Deleting consensus metadata
I20260923 19:36:56.747859 23742 ts_tablet_manager.cc:1905] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:36:56.749563 23230 catalog_manager.cc:4841] TS e6b353df4ecd452a8e63a1fa890ae3ff (127.12.159.194:43969): tablet 6b6db824f91641f49b7bd45253610b11 (table test-table [id=47b2129047a04b1fb4b0f4f2cbf9a28f]) successfully deleted
I20260923 19:36:56.756078 23742 ts_tablet_manager.cc:1918] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:56.756273 23742 log.cc:1196] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/6b6db824f91641f49b7bd45253610b11
I20260923 19:36:56.756834 23742 ts_tablet_manager.cc:1939] T 6b6db824f91641f49b7bd45253610b11 P e4b2fc1501214f55b40c9deff62e5dab: Deleting consensus metadata
I20260923 19:36:56.759393 23231 catalog_manager.cc:4841] TS e4b2fc1501214f55b40c9deff62e5dab (127.12.159.195:35195): tablet 6b6db824f91641f49b7bd45253610b11 (table test-table [id=47b2129047a04b1fb4b0f4f2cbf9a28f]) successfully deleted
Sep 23 19:36:56 dist-test-slave-lzv7 krb5kdc[23199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:36:56.764288 23744 ts_tablet_manager.cc:1918] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:36:56.764472 23744 log.cc:1196] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/6b6db824f91641f49b7bd45253610b11
I20260923 19:36:56.765035 23744 ts_tablet_manager.cc:1939] T 6b6db824f91641f49b7bd45253610b11 P cf1a272859a644f4aafec5b88fed59b7: Deleting consensus metadata
I20260923 19:36:56.767045 23230 catalog_manager.cc:4841] TS cf1a272859a644f4aafec5b88fed59b7 (127.12.159.193:44049): tablet 6b6db824f91641f49b7bd45253610b11 (table test-table [id=47b2129047a04b1fb4b0f4f2cbf9a28f]) successfully deleted
I20260923 19:36:56.775966 23718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.733083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54882 (local address 127.12.159.193:44049)
0923 19:36:56.734063 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.734069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.745688 (+ 11619us) server_negotiation.cc:407] Connection header received
0923 19:36:56.746223 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.746230 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.746312 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.746397 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:56.751344 (+ 4947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.752565 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.756333 (+ 3768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.757048 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.757151 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.767263 (+ 10112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:56.767281 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:56.767315 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:56.767380 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:56.772276 (+ 4896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.773210 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.773223 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.773228 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.773419 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.773880 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.773888 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.773893 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.774471 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:56.774820 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.775152 (+ 332us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.775457 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":832}
I20260923 19:36:56.776823 23428 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:56.878633 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 23305
I20260923 19:36:56.897943 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 23439
Sep 23 19:36:56 dist-test-slave-lzv7 krb5kdc[23199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:36:56.913421 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:56.898744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39508 (local address 127.12.159.194:43969)
0923 19:36:56.898984 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:56.898989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:56.899020 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:36:56.899132 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:56.899138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:56.899212 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:56.899331 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:56.900640 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.901389 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.903156 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:56.903550 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:56.903687 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:56.907679 (+ 3992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:56.907692 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:56.907707 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:56.907742 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:56.910721 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.911397 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.911404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.911406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.911525 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:56.911885 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:56.911892 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:56.911895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:56.912266 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:56.912564 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:56.912856 (+ 292us) server_negotiation.cc:299] Negotiation successful
0923 19:36:56.913080 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260923 19:36:56.914291 23562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:57.006449 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 23439
I20260923 19:36:57.023430 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 23572
Sep 23 19:36:57 dist-test-slave-lzv7 krb5kdc[23199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:36:57.039136 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:36:57.024293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60802 (local address 127.12.159.195:35195)
0923 19:36:57.024484 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:36:57.024491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:36:57.024512 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:36:57.024707 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:36:57.024719 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:36:57.024796 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:36:57.024905 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:36:57.026297 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:57.027050 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:57.028374 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:36:57.028780 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:36:57.028916 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:36:57.033250 (+ 4334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:36:57.033265 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:36:57.033281 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:36:57.033313 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:36:57.036190 (+ 2877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:57.036873 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:57.036880 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:57.036883 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:57.037014 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:36:57.037378 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:36:57.037383 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:36:57.037387 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:36:57.037770 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:36:57.038094 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0923 19:36:57.038585 (+ 491us) server_negotiation.cc:299] Negotiation successful
0923 19:36:57.038809 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:36:57.039865 23695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:57.133916 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 23572
I20260923 19:36:57.151111 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 23212
I20260923 19:36:57.152328 23274 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:36:57.262657 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 23212
2026-09-23T19:36:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4391 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:36:57 dist-test-slave-lzv7 krb5kdc[23752](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:36:57 dist-test-slave-lzv7 krb5kdc[23752](info): set up 2 sockets
Sep 23 19:36:57 dist-test-slave-lzv7 krb5kdc[23752](info): commencing operation
krb5kdc: starting...
W20260923 19:36:58.374833 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.005s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:36:58 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192218, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:36:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:36:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/rangeradmin_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/rangeradmin_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/rangerlookup_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/rangerlookup_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
I20260923 19:36:58.714998 12927 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWWieFZ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/postgres -l logfile start
2026-09-23 19:37:01.310 UTC [23782] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 19:37:01.310 UTC [23782] LOG: listening on IPv4 address "127.12.159.212", port 39897
2026-09-23 19:37:01.314 UTC [23782] LOG: listening on Unix socket "/tmp/.s.PGSQL.39897"
2026-09-23 19:37:01.337 UTC [23785] LOG: database system was shut down at 2026-09-23 19:36:59 UTC
2026-09-23 19:37:01.341 UTC [23782] LOG: database system is ready to accept connections
I20260923 19:37:02.314388 12927 mini_postgres.cc:96] Postgres bound to 39897
2026-09-23 19:37:02.333 UTC [23793] FATAL: database "slave" does not exist
127.12.159.212:39897 - accepting connections
I20260923 19:37:02.334146 12927 mini_ranger.cc:161] Starting Ranger...
I20260923 19:37:02.362133 12927 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 19:37:02.877907 12927 mini_ranger.cc:87] Created ranger Postgres database
I20260923 19:37:02.878043 12927 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-admin
2026-09-23 19:37:03,181 [I] DB FLAVOR :POSTGRES
2026-09-23 19:37:03,181 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:37:03,181 [I] Checking connection..
2026-09-23 19:37:03,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 19:37:03,446 [I] Checking connection passed.
2026-09-23 19:37:03,446 [I] --------- Verifying version history table ---------
2026-09-23 19:37:03,446 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:37:03,698 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:37:03,699 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:37:03,952 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:37:03,953 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 19:37:03,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 19:37:04.200 UTC [23857] WARNING: there is no transaction in progress
2026-09-23 19:37:04,206 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 19:37:04,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:37:04,479 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 19:37:04,479 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:37:04,479 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 19:37:04,742 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 19:37:04,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lzv7.c.gcp-upstream.internal','N') ;"
2026-09-23 19:37:05,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:37:05,494 [I] Table x_portal_user does not exist in database ranger
2026-09-23 19:37:05,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:37:05,764 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 19:37:05,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:37:06,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:37:06,252 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 19:37:06,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 19:37:07.260 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.276 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.293 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.311 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.328 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.347 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.405 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.413 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.427 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.438 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.448 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.462 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.472 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.479 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.486 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:07.493 UTC [23965] WARNING: there is no transaction in progress
2026-09-23 19:37:08,183 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 19:37:08,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 19:37:08,407 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 19:37:08,408 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:37:08,672 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 19:37:08,673 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:37:08,940 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 19:37:08,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:37:09,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:37:09,451 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lzv7.c.gcp-upstream.internal';"
2026-09-23 19:37:09,701 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 19:37:09,702 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 19:37:09,957 [I] DB_PATCHES have already been applied
I20260923 19:37:09.963505 12927 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWWieFZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 19:37:09.963642 12927 mini_ranger.cc:193] Using host: 127.12.159.212
I20260923 19:37:09.979732 12927 mini_ranger.cc:227] Ranger admin URL: http://127.12.159.212:54765
Sep 23, 2026 7:37:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:37:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:37:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 7:37:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 7:37:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 7:37:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 7:37:10 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 19:37:11.123972 12927 mini_ranger.cc:160] Time spent starting Ranger: real 8.790s user 0.010s sys 0.031s
Sep 23, 2026 7:37:32 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 7:37:32 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Sep 23, 2026 7:37:32 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 7:37:32 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 7:37:33 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 19:37:33.850948 12927 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/rangerkms_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/rangerkms_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.159.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.159.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 19:37:34 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192254, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 19:37:34.046619 12927 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 19:37:34.069238 12927 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 19:37:35.024328 12927 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 19:37:35.024506 12927 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms
I20260923 19:37:35.024626 12927 mini_ranger_kms.cc:227] Using postgres at 127.12.159.212:39897
2026-09-23 19:37:35,452 [I] DB FLAVOR :POSTGRES
2026-09-23 19:37:35,452 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:37:35,453 [I] Checking connection
2026-09-23 19:37:35,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 19:37:35,704 [I] connection success
2026-09-23 19:37:35,705 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 19:37:35,705 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 19:37:35,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 19:37:35,940 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 19:37:35,940 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:37:35,940 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 19:37:35,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:39897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 19:37:36,201 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 19:37:36.687996 12927 mini_ranger_kms.cc:310] Created kms service
I20260923 19:37:36.899482 12927 mini_ranger_kms.cc:326] Created kudu user
I20260923 19:37:36.947279 12927 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 19:37:36 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192254, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:37:37.367893 12927 mini_ranger_kms.cc:384] Added ranger policy
I20260923 19:37:37.368237 12927 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 19:37:37.368283 12927 mini_ranger_kms.cc:240] Using host: 127.12.159.212
I20260923 19:37:37.389976 12927 mini_ranger_kms.cc:276] Ranger KMS PID: 24146
I20260923 19:37:37.390167 12927 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.159.212:46649
Sep 23, 2026 7:37:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:37:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:37:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 7:37:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 7:37:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 7:37:38 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260923 19:37:39.677034 12927 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.630s user 0.119s sys 0.330s
I20260923 19:37:39.677306 12927 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 19:37:39.677536 12927 mini_ranger_kms.cc:401] 127.12.159.212:46649/kms/v1/keys
Sep 23 19:37:39 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192259, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.159.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 23 19:37:40 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192259, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.159.212@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
Sep 23 19:37:40 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192259, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.159.212@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
Sep 23 19:37:42 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:37:42.803124 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41475
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:41475
--ranger_config_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:46649/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:37:43.144433 24196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:37:43.144723 24196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:37:43.144879 24196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:37:43.152199 24196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:37:43.152308 24196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:37:43.152396 24196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:37:43.152483 24196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:37:43.152575 24196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:37:43.162653 24196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.159.212:46649/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:41475
--ranger_config_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:37:43.164055 24196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:37:43.165373 24196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:37:43.178002 24202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:43.178071 24204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:43.178071 24201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:37:43.178604 24196 server_base.cc:1034] running on GCE node
I20260923 19:37:43.179497 24196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:37:43.180981 24196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:37:43.182222 24196 hybrid_clock.cc:648] HybridClock initialized: now 1790192263182189 us; error 49 us; skew 500 ppm
I20260923 19:37:43.182577 24196 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:37:43 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192263, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:37:43.193524 24196 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:37:43.195127 24196 webserver.cc:460] Webserver started at http://127.12.159.254:42627/ using document root <none> and password file <none>
I20260923 19:37:43.195830 24196 fs_manager.cc:359] Metadata directory not provided
I20260923 19:37:43.195969 24196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:37:43.196295 24196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:37:43 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192263, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:37:43.258591 24196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "d7acc2893d4048f98a8b6e5942213659"
format_stamp: "Formatted at 2026-09-23 19:37:43 on dist-test-slave-lzv7"
server_key: "d49ea0167231a94fa53aadafd6ed997e"
server_key_iv: "60d0529637f162893c3613c659f83b6f"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:43.259421 24196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "d7acc2893d4048f98a8b6e5942213659"
format_stamp: "Formatted at 2026-09-23 19:37:43 on dist-test-slave-lzv7"
server_key: "d49ea0167231a94fa53aadafd6ed997e"
server_key_iv: "60d0529637f162893c3613c659f83b6f"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:43.265043 24196 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:37:43.282858 24211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:43.284502 24196 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:37:43.284662 24196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "d7acc2893d4048f98a8b6e5942213659"
format_stamp: "Formatted at 2026-09-23 19:37:43 on dist-test-slave-lzv7"
server_key: "d49ea0167231a94fa53aadafd6ed997e"
server_key_iv: "60d0529637f162893c3613c659f83b6f"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:43.284874 24196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:37:43.317581 24196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:37:43.321241 24196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:37:43.321493 24196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:37:43.340540 24196 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:41475
I20260923 19:37:43.340560 24262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:41475 every 8 connection(s)
I20260923 19:37:43.341933 24196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:37:43.344393 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 24196
I20260923 19:37:43.344591 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:37:43.345244 12927 external_mini_cluster.cc:1428] Setting key feb48a3c581b83658f108785fcc7b354
I20260923 19:37:43.346099 24263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:37:43 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:37:43.361196 24263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659: Bootstrap starting.
I20260923 19:37:43.366014 24263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659: Neither blocks nor log segments found. Creating new log.
I20260923 19:37:43.367450 24263 log.cc:824] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659: Log is configured to *not* fsync() on all Append() calls
I20260923 19:37:43.370651 24266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:43.347367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41912 (local address 127.12.159.254:41475)
0923 19:37:43.348210 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:43.348228 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:43.348282 (+ 54us) server_negotiation.cc:407] Connection header received
0923 19:37:43.350071 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:43.350111 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:43.350672 (+ 561us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:43.351185 (+ 513us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:43.352340 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:43.354624 (+ 2284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:43.355931 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:43.357040 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:43.357268 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:43.361395 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:43.361408 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:43.361428 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:43.361475 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:43.365601 (+ 4126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:43.366441 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:43.366453 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:43.366463 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:43.366722 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:43.367130 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:43.367139 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:43.367143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:43.367869 (+ 726us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:43.368250 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:43.368726 (+ 476us) server_negotiation.cc:299] Negotiation successful
0923 19:37:43.369179 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":340,"threads_started":1}
I20260923 19:37:43.371286 24263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659: No bootstrap required, opened a new log
I20260923 19:37:43.379123 24263 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7acc2893d4048f98a8b6e5942213659" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41475 } }
I20260923 19:37:43.379520 24263 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:37:43.379633 24263 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7acc2893d4048f98a8b6e5942213659, State: Initialized, Role: FOLLOWER
I20260923 19:37:43.380302 24263 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7acc2893d4048f98a8b6e5942213659" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41475 } }
I20260923 19:37:43.380515 24263 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:37:43.380609 24263 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:37:43.380738 24263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:37:43.382843 24263 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7acc2893d4048f98a8b6e5942213659" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41475 } }
I20260923 19:37:43.383306 24263 leader_election.cc:302] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7acc2893d4048f98a8b6e5942213659; no voters:
I20260923 19:37:43.383811 24263 leader_election.cc:288] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:37:43.383965 24268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:37:43.384673 24268 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [term 1 LEADER]: Becoming Leader. State: Replica: d7acc2893d4048f98a8b6e5942213659, State: Running, Role: LEADER
I20260923 19:37:43.385232 24268 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7acc2893d4048f98a8b6e5942213659" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41475 } }
I20260923 19:37:43.385921 24263 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:37:43.388818 24269 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7acc2893d4048f98a8b6e5942213659" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7acc2893d4048f98a8b6e5942213659" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41475 } } }
I20260923 19:37:43.389225 24269 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [sys.catalog]: This master's current role is: LEADER
I20260923 19:37:43.389099 24270 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7acc2893d4048f98a8b6e5942213659. Latest consensus state: current_term: 1 leader_uuid: "d7acc2893d4048f98a8b6e5942213659" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7acc2893d4048f98a8b6e5942213659" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41475 } } }
I20260923 19:37:43.389415 24270 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659 [sys.catalog]: This master's current role is: LEADER
I20260923 19:37:43.391275 24275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:37:43.396385 24275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:37:43.396988 24263 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 19:37:43.415022 24275 catalog_manager.cc:1347] Generated new cluster ID: e19db9711ed74dd1a09fd26775998761
I20260923 19:37:43.415206 24275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:37:43.435284 24275 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:37:43.437361 24275 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:37:43.452711 24275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659: Generated new TSK 0
I20260923 19:37:43.453963 24275 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:37:44.218726 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:46649/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41475
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:37:44 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192264, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260923 19:37:44.656028 24308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:37:44.656467 24308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:37:44.656646 24308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:37:44.666432 24308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:37:44.666592 24308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:37:44.666774 24308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:37:44.678860 24308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.159.212:46649/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:37:44.680330 24308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:37:44.681746 24308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:37:44.708406 24318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:44.709189 24319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:44.714399 24322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:37:44.715076 24308 server_base.cc:1034] running on GCE node
I20260923 19:37:44.715898 24308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:37:44.717031 24308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:37:44.718515 24308 hybrid_clock.cc:648] HybridClock initialized: now 1790192264718405 us; error 99 us; skew 500 ppm
I20260923 19:37:44.718884 24308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:37:44 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192264, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:37:44.722576 24308 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:37:44.727229 24308 webserver.cc:460] Webserver started at http://127.12.159.193:44779/ using document root <none> and password file <none>
I20260923 19:37:44.728034 24308 fs_manager.cc:359] Metadata directory not provided
I20260923 19:37:44.728185 24308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:37:44.728528 24308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:37:44 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192264, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:37:44.745844 24308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "eae8590d5d66464f9ed4b138a2030130"
format_stamp: "Formatted at 2026-09-23 19:37:44 on dist-test-slave-lzv7"
server_key: "3b8c2453cd9b15cef2f38449a40d8e85"
server_key_iv: "268999dd698e693cd76551bd9a8419d8"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:44.747022 24308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "eae8590d5d66464f9ed4b138a2030130"
format_stamp: "Formatted at 2026-09-23 19:37:44 on dist-test-slave-lzv7"
server_key: "3b8c2453cd9b15cef2f38449a40d8e85"
server_key_iv: "268999dd698e693cd76551bd9a8419d8"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:44.763980 24308 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.006s sys 0.009s
I20260923 19:37:44.794526 24328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:44.796505 24308 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.007s
I20260923 19:37:44.796741 24308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "eae8590d5d66464f9ed4b138a2030130"
format_stamp: "Formatted at 2026-09-23 19:37:44 on dist-test-slave-lzv7"
server_key: "3b8c2453cd9b15cef2f38449a40d8e85"
server_key_iv: "268999dd698e693cd76551bd9a8419d8"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:44.796999 24308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:37:44.835249 24308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:37:44.840983 24308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:37:44.841425 24308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:37:44.862285 24308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:37:44.869127 24308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:37:44.869333 24308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260923 19:37:44.869881 24308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:37:44.870052 24308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
Sep 23 19:37:45 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192264, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:37:45.268374 24308 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:37235
I20260923 19:37:45.268471 24440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:37235 every 8 connection(s)
I20260923 19:37:45.269724 24308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:37:45.271478 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 24308
I20260923 19:37:45.271725 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:37:45.272696 12927 external_mini_cluster.cc:1428] Setting key 11a60e79e7b13fe4d8d9ae638e27a4af
Sep 23 19:37:45 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192264, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:37:45.306237 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:45.276392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:44333 (local address 127.12.159.254:41475)
0923 19:37:45.281420 (+ 5028us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:45.281424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:45.281439 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:37:45.281487 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:45.281495 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:45.281558 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:45.281695 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:45.283843 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:45.285067 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:45.287953 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:45.288582 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:45.288728 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:45.297335 (+ 8607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:45.297342 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:45.297347 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:45.297400 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:45.301981 (+ 4581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:45.303123 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:45.303129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:45.303133 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:45.303294 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:45.303836 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:45.303840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:45.303843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:45.304294 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:45.304430 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:45.305498 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0923 19:37:45.305734 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4927,"thread_start_us":4814,"threads_started":1}
I20260923 19:37:45.307595 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:45.275844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41475 (local address 127.12.159.193:44333)
0923 19:37:45.276699 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:45.276753 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:45.280630 (+ 3877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:45.282005 (+ 1375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:45.282020 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:45.282726 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:37:45.283614 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:45.283643 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:45.285277 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:45.285285 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:45.287745 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:45.287763 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:45.288833 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:45.288840 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:45.289112 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:45.294004 (+ 4892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:37:45.294038 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:37:45.297001 (+ 2963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:37:45.302216 (+ 5215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:37:45.302225 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:37:45.302245 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:37:45.302947 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:37:45.303439 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:37:45.303444 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:37:45.303447 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:37:45.303700 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:37:45.304500 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:37:45.304509 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:37:45.304995 (+ 486us) client_negotiation.cc:769] Sending connection context
0923 19:37:45.305337 (+ 342us) client_negotiation.cc:240] Negotiation successful
0923 19:37:45.305915 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":567,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
I20260923 19:37:45.309537 24441 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41475
I20260923 19:37:45.309957 24441 heartbeater.cc:464] Registering TS with master...
I20260923 19:37:45.310863 24441 heartbeater.cc:511] Master 127.12.159.254:41475 requested a full tablet report, sending...
I20260923 19:37:45.313537 24228 ts_manager.cc:194] Registered new tserver with Master: eae8590d5d66464f9ed4b138a2030130 (127.12.159.193:37235)
I20260923 19:37:45.315697 24228 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:44333
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:37:45.344880 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:46649/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41475
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:37:45 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192264, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
W20260923 19:37:45.819983 24447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:37:45.820281 24447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:37:45.820426 24447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:37:45.827734 24447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:37:45.827838 24447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:37:45.828009 24447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:37:45.837752 24447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.159.212:46649/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:37:45.839182 24447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:37:45.840530 24447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:37:45.854579 24464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:45.854619 24462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:45.854661 24461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:37:45.859683 24447 server_base.cc:1034] running on GCE node
I20260923 19:37:45.860364 24447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:37:45.861367 24447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:37:45.862581 24447 hybrid_clock.cc:648] HybridClock initialized: now 1790192265862528 us; error 49 us; skew 500 ppm
I20260923 19:37:45.862955 24447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:37:45 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192265, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:37:45.866468 24447 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:37:45.868055 24447 webserver.cc:460] Webserver started at http://127.12.159.194:33365/ using document root <none> and password file <none>
I20260923 19:37:45.868818 24447 fs_manager.cc:359] Metadata directory not provided
I20260923 19:37:45.868963 24447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:37:45.869268 24447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:37:45 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192265, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:37:45.887799 24447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "50533c828e8f45458a475c1f62a6105b"
format_stamp: "Formatted at 2026-09-23 19:37:45 on dist-test-slave-lzv7"
server_key: "0145f14af19bbf971e8fa10cc8129e92"
server_key_iv: "b99121a76e832a34d9556f47b0a9f864"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:45.888928 24447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "50533c828e8f45458a475c1f62a6105b"
format_stamp: "Formatted at 2026-09-23 19:37:45 on dist-test-slave-lzv7"
server_key: "0145f14af19bbf971e8fa10cc8129e92"
server_key_iv: "b99121a76e832a34d9556f47b0a9f864"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:45.896174 24447 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260923 19:37:45.914865 24471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:45.916736 24447 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:37:45.916923 24447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "50533c828e8f45458a475c1f62a6105b"
format_stamp: "Formatted at 2026-09-23 19:37:45 on dist-test-slave-lzv7"
server_key: "0145f14af19bbf971e8fa10cc8129e92"
server_key_iv: "b99121a76e832a34d9556f47b0a9f864"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:45.917194 24447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:37:45.955883 24447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:37:45.960846 24447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:37:45.961176 24447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:37:45.962357 24447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:37:45.964095 24447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:37:45.964186 24447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:45.964303 24447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:37:45.964365 24447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:46.001751 24447 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:45719
I20260923 19:37:46.001782 24583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:45719 every 8 connection(s)
I20260923 19:37:46.003407 24447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:37:46.006938 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 24447
I20260923 19:37:46.007124 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:37:46.007701 12927 external_mini_cluster.cc:1428] Setting key 2b6fdb60dbb195bd34a58b26e238b4b8
Sep 23 19:37:46 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192265, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:37:46.028614 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.006238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:36899 (local address 127.12.159.254:41475)
0923 19:37:46.008727 (+ 2489us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.008733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.008752 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:37:46.010477 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.010484 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.010582 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.010698 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:46.012541 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.013739 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.016082 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.016603 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.016745 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.021071 (+ 4326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:46.021075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:46.021079 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:46.021108 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:46.024785 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.025735 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.025740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.025744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.025935 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.026506 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.026512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.026515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.026885 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:46.027024 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.027982 (+ 958us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.028221 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2369,"thread_start_us":237,"threads_started":1}
I20260923 19:37:46.030000 24587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.006882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41475 (local address 127.12.159.194:36899)
0923 19:37:46.007775 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.007830 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.010164 (+ 2334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.010965 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.010977 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.011541 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:37:46.012347 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.012372 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.013927 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.013932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.015922 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.015937 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.016848 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.016855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.017091 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.017837 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:37:46.017873 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:37:46.020844 (+ 2971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:37:46.024932 (+ 4088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:37:46.024946 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:37:46.024966 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:37:46.025594 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:37:46.026052 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:37:46.026059 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:37:46.026066 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:37:46.026347 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:37:46.027055 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:37:46.027067 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:37:46.027542 (+ 475us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.027872 (+ 330us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.028439 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":360,"threads_started":1}
I20260923 19:37:46.031695 24584 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41475
I20260923 19:37:46.032039 24584 heartbeater.cc:464] Registering TS with master...
I20260923 19:37:46.033018 24584 heartbeater.cc:511] Master 127.12.159.254:41475 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:37:46.034793 24228 ts_manager.cc:194] Registered new tserver with Master: 50533c828e8f45458a475c1f62a6105b (127.12.159.194:45719)
I20260923 19:37:46.035919 24228 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:36899
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:37:46.065263 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:46649/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41475
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:37:46.319478 24441 heartbeater.cc:503] Master 127.12.159.254:41475 was elected leader, sending a full tablet report...
W20260923 19:37:46.401394 24590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:37:46.401782 24590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:37:46.402065 24590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:37:46.409610 24590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:37:46.409724 24590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:37:46.409945 24590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:37:46.420490 24590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.159.212:46649/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:37:46.421936 24590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:37:46.423360 24590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:37:46.436609 24595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:46.436606 24596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:37:46.436694 24598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:37:46.437705 24590 server_base.cc:1034] running on GCE node
I20260923 19:37:46.438375 24590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:37:46.439352 24590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:37:46.440589 24590 hybrid_clock.cc:648] HybridClock initialized: now 1790192266440536 us; error 66 us; skew 500 ppm
I20260923 19:37:46.440932 24590 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:37:46 dist-test-slave-lzv7 krb5kdc[23752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192266, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:37:46.448686 24590 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:37:46.450381 24590 webserver.cc:460] Webserver started at http://127.12.159.195:44591/ using document root <none> and password file <none>
I20260923 19:37:46.451064 24590 fs_manager.cc:359] Metadata directory not provided
I20260923 19:37:46.451208 24590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:37:46.451519 24590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:37:46 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192266, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:37:46.474885 24590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "fc2da2a699e74e0d8a4d0f1aca33e058"
format_stamp: "Formatted at 2026-09-23 19:37:46 on dist-test-slave-lzv7"
server_key: "081d59a821543518cbd735e30fb5d86d"
server_key_iv: "e7af676d6db9ba635ed098cceb3d210f"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:46.476081 24590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "fc2da2a699e74e0d8a4d0f1aca33e058"
format_stamp: "Formatted at 2026-09-23 19:37:46 on dist-test-slave-lzv7"
server_key: "081d59a821543518cbd735e30fb5d86d"
server_key_iv: "e7af676d6db9ba635ed098cceb3d210f"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:46.484033 24590 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.007s
I20260923 19:37:46.505123 24605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:46.507246 24590 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260923 19:37:46.507452 24590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "fc2da2a699e74e0d8a4d0f1aca33e058"
format_stamp: "Formatted at 2026-09-23 19:37:46 on dist-test-slave-lzv7"
server_key: "081d59a821543518cbd735e30fb5d86d"
server_key_iv: "e7af676d6db9ba635ed098cceb3d210f"
server_key_version: "kuduclusterkey@0"
I20260923 19:37:46.507742 24590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:37:46.540944 24590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:37:46.545075 24590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:37:46.545341 24590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:37:46.546345 24590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:37:46.547636 24590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:37:46.547708 24590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:46.547838 24590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:37:46.547911 24590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:37:46.580668 24590 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:42201
I20260923 19:37:46.580711 24717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:42201 every 8 connection(s)
I20260923 19:37:46.582031 24590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:37:46.588902 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 24590
I20260923 19:37:46.589105 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:37:46.589583 12927 external_mini_cluster.cc:1428] Setting key 223773820b7e1f32e1fd1fc9259ff247
Sep 23 19:37:46 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192266, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:37:46.602085 24720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.584872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:53295 (local address 127.12.159.254:41475)
0923 19:37:46.585389 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.585394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.586414 (+ 1020us) server_negotiation.cc:407] Connection header received
0923 19:37:46.588225 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.588230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.588348 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.588463 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:46.590222 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.591057 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.592769 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.593190 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.593317 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.596642 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:46.596647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:46.596650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:46.596678 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:46.599064 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.599766 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.599776 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.599779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.599896 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.600357 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.600362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.600366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.600615 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:46.600764 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.601487 (+ 723us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.601692 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":272,"threads_started":1}
I20260923 19:37:46.603024 24721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.585468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41475 (local address 127.12.159.195:53295)
0923 19:37:46.586263 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.586299 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.587961 (+ 1662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.588705 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.588714 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.589284 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:37:46.590059 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.590079 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.591206 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.591212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.592632 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.592643 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.593411 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.593418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.593675 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.594477 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:37:46.594500 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:37:46.596448 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:37:46.599210 (+ 2762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:37:46.599218 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:37:46.599235 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:37:46.599642 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:37:46.600033 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:37:46.600038 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:37:46.600042 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:37:46.600238 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:37:46.600757 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:37:46.600765 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:37:46.601126 (+ 361us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.601392 (+ 266us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.601911 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":324,"threads_started":1}
I20260923 19:37:46.604375 24718 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41475
I20260923 19:37:46.604700 24718 heartbeater.cc:464] Registering TS with master...
I20260923 19:37:46.605383 24718 heartbeater.cc:511] Master 127.12.159.254:41475 requested a full tablet report, sending...
I20260923 19:37:46.606901 24228 ts_manager.cc:194] Registered new tserver with Master: fc2da2a699e74e0d8a4d0f1aca33e058 (127.12.159.195:42201)
I20260923 19:37:46.607882 24228 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:53295
I20260923 19:37:46.617741 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:37:46.635154 24720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.622418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41924 (local address 127.12.159.254:41475)
0923 19:37:46.622612 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.622619 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.623064 (+ 445us) server_negotiation.cc:407] Connection header received
0923 19:37:46.623201 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.623204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.623309 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.623408 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:46.624848 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.625551 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.626967 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.627394 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.627503 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.630044 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:46.630048 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:46.630058 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:46.630087 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:46.632685 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.633283 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.633287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.633289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.633392 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.633872 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.633880 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.633884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.634217 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:46.634412 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.634735 (+ 323us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.634905 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:37:46.639117 24228 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:37:46.646203 24228 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:37:46.672170 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.659239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:37235 (local address 127.0.0.1:33380)
0923 19:37:46.661363 (+ 2124us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.661421 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.661643 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.663460 (+ 1817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.663470 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.663517 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:37:46.663985 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.664002 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.666341 (+ 2339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.666347 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.669117 (+ 2770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.669165 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.671038 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.671049 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.671273 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.671362 (+ 89us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.671503 (+ 141us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.671705 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1799,"mutex_wait_us":41,"thread_start_us":3597,"threads_started":1}
I20260923 19:37:46.672204 24732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.659408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33380 (local address 127.12.159.193:37235)
0923 19:37:46.662730 (+ 3322us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.662741 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.662779 (+ 38us) server_negotiation.cc:407] Connection header received
0923 19:37:46.662917 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.662925 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.663209 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.664208 (+ 999us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:37:46.664464 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.666188 (+ 1724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.669293 (+ 3105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.670655 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.670865 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.671083 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.671669 (+ 586us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.671855 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3137,"thread_start_us":2993,"threads_started":1}
I20260923 19:37:46.672284 24731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.659672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:42201 (local address 127.0.0.1:35386)
0923 19:37:46.663089 (+ 3417us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.663106 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.663311 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.664251 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.664266 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.664294 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:37:46.664725 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.664738 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.666663 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.666668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.669413 (+ 2745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.669425 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.671392 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.671398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.671586 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.671639 (+ 53us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.671727 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.671868 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3301,"mutex_wait_us":446,"thread_start_us":1169,"threads_started":1}
I20260923 19:37:46.673023 24733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.659700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35386 (local address 127.12.159.195:42201)
0923 19:37:46.662339 (+ 2639us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.662349 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.663208 (+ 859us) server_negotiation.cc:407] Connection header received
0923 19:37:46.663506 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.663513 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.663760 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.663938 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:37:46.664939 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.666468 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.669595 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.671166 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.671365 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.671533 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.672539 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.672705 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2461,"thread_start_us":2308,"threads_started":1}
I20260923 19:37:46.676838 24376 tablet_service.cc:1467] Processing CreateTablet for tablet 22642113f0c243d9a0c4e33bf6bb5c37 (DEFAULT_TABLE table=test-table [id=6b0c768e19094ebabec37b22e0a340c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:37:46.676833 24653 tablet_service.cc:1467] Processing CreateTablet for tablet 22642113f0c243d9a0c4e33bf6bb5c37 (DEFAULT_TABLE table=test-table [id=6b0c768e19094ebabec37b22e0a340c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:37:46.677700 24735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.663263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:45719 (local address 127.0.0.1:59358)
0923 19:37:46.669924 (+ 6661us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.669942 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.670047 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.670712 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.670720 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.670752 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:37:46.671193 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.671203 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.673113 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.673131 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.675165 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.675179 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.676928 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.676935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.677096 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.677138 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.677238 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.677367 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6497,"thread_start_us":6379,"threads_started":1}
I20260923 19:37:46.677785 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.664082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59358 (local address 127.12.159.194:45719)
0923 19:37:46.669982 (+ 5900us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.669993 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.670023 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:37:46.670219 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.670228 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.670490 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.670699 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:37:46.671419 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.672940 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.675355 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.676707 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.676901 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.677065 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.677293 (+ 228us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.677453 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5109,"thread_start_us":4999,"threads_started":1}
I20260923 19:37:46.678376 24376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22642113f0c243d9a0c4e33bf6bb5c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:37:46.678388 24653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22642113f0c243d9a0c4e33bf6bb5c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:37:46.680790 24519 tablet_service.cc:1467] Processing CreateTablet for tablet 22642113f0c243d9a0c4e33bf6bb5c37 (DEFAULT_TABLE table=test-table [id=6b0c768e19094ebabec37b22e0a340c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:37:46.681983 24519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22642113f0c243d9a0c4e33bf6bb5c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:37:46.694566 24737 tablet_bootstrap.cc:492] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Bootstrap starting.
I20260923 19:37:46.695413 24738 tablet_bootstrap.cc:492] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Bootstrap starting.
I20260923 19:37:46.696175 24739 tablet_bootstrap.cc:492] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Bootstrap starting.
I20260923 19:37:46.699313 24739 tablet_bootstrap.cc:654] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Neither blocks nor log segments found. Creating new log.
I20260923 19:37:46.699623 24738 tablet_bootstrap.cc:654] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Neither blocks nor log segments found. Creating new log.
I20260923 19:37:46.700527 24739 log.cc:824] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Log is configured to *not* fsync() on all Append() calls
I20260923 19:37:46.700824 24738 log.cc:824] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Log is configured to *not* fsync() on all Append() calls
I20260923 19:37:46.701237 24737 tablet_bootstrap.cc:654] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Neither blocks nor log segments found. Creating new log.
I20260923 19:37:46.702642 24737 log.cc:824] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Log is configured to *not* fsync() on all Append() calls
I20260923 19:37:46.704412 24739 tablet_bootstrap.cc:492] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: No bootstrap required, opened a new log
I20260923 19:37:46.704669 24738 tablet_bootstrap.cc:492] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: No bootstrap required, opened a new log
I20260923 19:37:46.704681 24739 ts_tablet_manager.cc:1397] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260923 19:37:46.704943 24738 ts_tablet_manager.cc:1397] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260923 19:37:46.705682 24737 tablet_bootstrap.cc:492] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: No bootstrap required, opened a new log
I20260923 19:37:46.705976 24737 ts_tablet_manager.cc:1397] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260923 19:37:46.711982 24739 raft_consensus.cc:348] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.712430 24739 raft_consensus.cc:374] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:37:46.712532 24739 raft_consensus.cc:729] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2da2a699e74e0d8a4d0f1aca33e058, State: Initialized, Role: FOLLOWER
I20260923 19:37:46.713670 24739 consensus_queue.cc:260] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.714849 24718 heartbeater.cc:503] Master 127.12.159.254:41475 was elected leader, sending a full tablet report...
I20260923 19:37:46.715642 24739 ts_tablet_manager.cc:1428] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260923 19:37:46.715720 24738 raft_consensus.cc:348] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.716135 24738 raft_consensus.cc:374] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:37:46.716249 24738 raft_consensus.cc:729] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae8590d5d66464f9ed4b138a2030130, State: Initialized, Role: FOLLOWER
I20260923 19:37:46.716387 24737 raft_consensus.cc:348] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.716786 24737 raft_consensus.cc:374] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:37:46.716889 24737 raft_consensus.cc:729] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50533c828e8f45458a475c1f62a6105b, State: Initialized, Role: FOLLOWER
I20260923 19:37:46.716845 24738 consensus_queue.cc:260] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.717444 24737 consensus_queue.cc:260] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.718771 24738 ts_tablet_manager.cc:1428] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260923 19:37:46.720561 24584 heartbeater.cc:503] Master 127.12.159.254:41475 was elected leader, sending a full tablet report...
I20260923 19:37:46.721210 24737 ts_tablet_manager.cc:1428] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Time spent starting tablet: real 0.015s user 0.005s sys 0.009s
I20260923 19:37:46.721391 24746 raft_consensus.cc:482] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:37:46.721709 24746 raft_consensus.cc:504] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.724504 24746 leader_election.cc:288] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2da2a699e74e0d8a4d0f1aca33e058 (127.12.159.195:42201), 50533c828e8f45458a475c1f62a6105b (127.12.159.194:45719)
I20260923 19:37:46.728443 24743 raft_consensus.cc:482] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:37:46.728768 24743 raft_consensus.cc:504] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.730666 24743 leader_election.cc:288] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eae8590d5d66464f9ed4b138a2030130 (127.12.159.193:37235), 50533c828e8f45458a475c1f62a6105b (127.12.159.194:45719)
I20260923 19:37:46.733364 24733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.725484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:42091 (local address 127.12.159.195:42201)
0923 19:37:46.725733 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.725743 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.726601 (+ 858us) server_negotiation.cc:407] Connection header received
0923 19:37:46.726771 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.726779 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.726844 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.726935 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:37:46.727731 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.728557 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.731050 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.732147 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.732317 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.732382 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.732953 (+ 571us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.733102 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 19:37:46.733701 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.725784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:34071 (local address 127.12.159.194:45719)
0923 19:37:46.726085 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.726092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.726309 (+ 217us) server_negotiation.cc:407] Connection header received
0923 19:37:46.726512 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.726517 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.726587 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.726669 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:37:46.727550 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.728383 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.730425 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.731732 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.731874 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.731952 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.733232 (+ 1280us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.733427 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
I20260923 19:37:46.734146 24747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.724671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:42201 (local address 127.12.159.193:42091)
0923 19:37:46.726496 (+ 1825us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.726515 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.726649 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.726975 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.726979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.727026 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:37:46.727586 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.727596 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.728756 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.728762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.730894 (+ 2132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.730907 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.732532 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.732538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.732759 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.732812 (+ 53us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.733565 (+ 753us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.733709 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":34,"thread_start_us":322,"threads_started":1}
I20260923 19:37:46.734841 24748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.724871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:45719 (local address 127.12.159.193:34071)
0923 19:37:46.726198 (+ 1327us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.726216 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.726377 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.726821 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.726826 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.726866 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:37:46.727384 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.727396 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.728502 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.728509 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.730277 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.730289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.732667 (+ 2378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.732677 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.732973 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.733028 (+ 55us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.734040 (+ 1012us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.734269 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1209,"mutex_wait_us":1,"spinlock_wait_cycles":17664,"thread_start_us":1094,"threads_started":1}
I20260923 19:37:46.735327 24673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22642113f0c243d9a0c4e33bf6bb5c37" candidate_uuid: "eae8590d5d66464f9ed4b138a2030130" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" is_pre_election: true
I20260923 19:37:46.735826 24673 raft_consensus.cc:2454] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae8590d5d66464f9ed4b138a2030130 in term 0.
I20260923 19:37:46.736583 24329 leader_election.cc:302] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eae8590d5d66464f9ed4b138a2030130, fc2da2a699e74e0d8a4d0f1aca33e058; no voters:
I20260923 19:37:46.737002 24746 raft_consensus.cc:2781] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:37:46.737172 24746 raft_consensus.cc:482] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:37:46.737323 24746 raft_consensus.cc:3037] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:37:46.737349 24539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22642113f0c243d9a0c4e33bf6bb5c37" candidate_uuid: "eae8590d5d66464f9ed4b138a2030130" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50533c828e8f45458a475c1f62a6105b" is_pre_election: true
I20260923 19:37:46.737885 24539 raft_consensus.cc:2454] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eae8590d5d66464f9ed4b138a2030130 in term 0.
I20260923 19:37:46.738849 24721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.731006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:37235 (local address 127.12.159.195:35181)
0923 19:37:46.731898 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.731917 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.732015 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.732831 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.732836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.732865 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:37:46.733087 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.733097 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.734615 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.734624 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.736382 (+ 1758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.736393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.738060 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.738066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.738272 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.738315 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.738423 (+ 108us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.738585 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780}
I20260923 19:37:46.739601 24732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.732300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:35181 (local address 127.12.159.193:37235)
0923 19:37:46.732461 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.732470 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.732485 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:37:46.732539 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.732543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.732610 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.732697 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:37:46.733253 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.734416 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.736519 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.737885 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.738058 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.738132 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.739227 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.739367 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":422,"server-negotiator.queue_time_us":38}
I20260923 19:37:46.740605 24396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22642113f0c243d9a0c4e33bf6bb5c37" candidate_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eae8590d5d66464f9ed4b138a2030130" is_pre_election: true
I20260923 19:37:46.740612 24746 raft_consensus.cc:504] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.741101 24396 raft_consensus.cc:2379] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc2da2a699e74e0d8a4d0f1aca33e058 in current term 1: Already voted for candidate eae8590d5d66464f9ed4b138a2030130 in this term.
I20260923 19:37:46.741775 24673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22642113f0c243d9a0c4e33bf6bb5c37" candidate_uuid: "eae8590d5d66464f9ed4b138a2030130" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058"
I20260923 19:37:46.742019 24673 raft_consensus.cc:3037] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:37:46.742344 24746 leader_election.cc:288] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [CANDIDATE]: Term 1 election: Requested vote from peers fc2da2a699e74e0d8a4d0f1aca33e058 (127.12.159.195:42201), 50533c828e8f45458a475c1f62a6105b (127.12.159.194:45719)
I20260923 19:37:46.742538 24539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22642113f0c243d9a0c4e33bf6bb5c37" candidate_uuid: "eae8590d5d66464f9ed4b138a2030130" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50533c828e8f45458a475c1f62a6105b"
I20260923 19:37:46.742733 24539 raft_consensus.cc:3037] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:37:46.744380 24673 raft_consensus.cc:2454] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae8590d5d66464f9ed4b138a2030130 in term 1.
I20260923 19:37:46.744733 24329 leader_election.cc:302] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eae8590d5d66464f9ed4b138a2030130, fc2da2a699e74e0d8a4d0f1aca33e058; no voters:
I20260923 19:37:46.745003 24746 raft_consensus.cc:2781] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:37:46.745044 24539 raft_consensus.cc:2454] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eae8590d5d66464f9ed4b138a2030130 in term 1.
I20260923 19:37:46.745154 24746 raft_consensus.cc:686] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 1 LEADER]: Becoming Leader. State: Replica: eae8590d5d66464f9ed4b138a2030130, State: Running, Role: LEADER
I20260923 19:37:46.745657 24746 consensus_queue.cc:237] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } }
I20260923 19:37:46.747961 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.732284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:54995 (local address 127.12.159.194:45719)
0923 19:37:46.733963 (+ 1679us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.733971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.733994 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:37:46.736661 (+ 2667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.736667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.736739 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.736796 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:37:46.738978 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.739681 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.746159 (+ 6478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.746976 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.747171 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.747244 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.747545 (+ 301us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.747669 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1560,"thread_start_us":4060,"threads_started":1}
I20260923 19:37:46.748970 24749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.731429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:45719 (local address 127.12.159.195:54995)
0923 19:37:46.732219 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0923 19:37:46.732236 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:37:46.736516 (+ 4280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:37:46.738387 (+ 1871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:37:46.738391 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:37:46.738419 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:37:46.738808 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.738819 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.739838 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.739843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.745997 (+ 6154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:37:46.746011 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.747177 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.747183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:37:46.747365 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.747389 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 19:37:46.747490 (+ 101us) client_negotiation.cc:240] Negotiation successful
0923 19:37:46.747629 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":909,"threads_started":1}
I20260923 19:37:46.749570 24539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22642113f0c243d9a0c4e33bf6bb5c37" candidate_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50533c828e8f45458a475c1f62a6105b" is_pre_election: true
I20260923 19:37:46.749897 24539 raft_consensus.cc:2379] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc2da2a699e74e0d8a4d0f1aca33e058 in current term 1: Already voted for candidate eae8590d5d66464f9ed4b138a2030130 in this term.
I20260923 19:37:46.750479 24607 leader_election.cc:302] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc2da2a699e74e0d8a4d0f1aca33e058; no voters: 50533c828e8f45458a475c1f62a6105b, eae8590d5d66464f9ed4b138a2030130
I20260923 19:37:46.750212 24227 catalog_manager.cc:5495] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 reported cstate change: term changed from 0 to 1, leader changed from <none> to eae8590d5d66464f9ed4b138a2030130 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "eae8590d5d66464f9ed4b138a2030130" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eae8590d5d66464f9ed4b138a2030130" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 37235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 } health_report { overall_health: UNKNOWN } } }
I20260923 19:37:46.750900 24743 raft_consensus.cc:2726] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:37:46.755331 24585 tablet.cc:2369] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:37:46.772495 24442 tablet.cc:2369] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:37:46.777505 24732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.771873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33382 (local address 127.12.159.193:37235)
0923 19:37:46.772067 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.772074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.772198 (+ 124us) server_negotiation.cc:407] Connection header received
0923 19:37:46.772402 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.772407 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.772532 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.772705 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:37:46.773072 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.774031 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.775406 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.775779 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.775866 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.776285 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:37:46.776913 (+ 628us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:37:46.777018 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.777113 (+ 95us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.777173 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:37:46.785828 24539 raft_consensus.cc:1261] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 1 FOLLOWER]: Refusing update from remote peer eae8590d5d66464f9ed4b138a2030130: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:37:46.785876 24673 raft_consensus.cc:1261] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 1 FOLLOWER]: Refusing update from remote peer eae8590d5d66464f9ed4b138a2030130: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:37:46.786815 24744 consensus_queue.cc:1035] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50533c828e8f45458a475c1f62a6105b" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:37:46.787163 24746 consensus_queue.cc:1035] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2da2a699e74e0d8a4d0f1aca33e058" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 42201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:37:46.802006 24753 mvcc.cc:205] Tried to move back new op lower bound from 7332627524743598080 to 7332627524594462720. Current Snapshot: MvccSnapshot[applied={T|T < 7332627524743598080}]
I20260923 19:37:46.816372 24227 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:37:46.816643 24227 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:37:46.820437 24227 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7acc2893d4048f98a8b6e5942213659: Sending DeleteTablet for 3 replicas of tablet 22642113f0c243d9a0c4e33bf6bb5c37
I20260923 19:37:46.821744 24653 tablet_service.cc:1514] Processing DeleteTablet for tablet 22642113f0c243d9a0c4e33bf6bb5c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:37:46 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:35386
I20260923 19:37:46.821784 24376 tablet_service.cc:1514] Processing DeleteTablet for tablet 22642113f0c243d9a0c4e33bf6bb5c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:37:46 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:33380
I20260923 19:37:46.821859 24519 tablet_service.cc:1514] Processing DeleteTablet for tablet 22642113f0c243d9a0c4e33bf6bb5c37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:37:46 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:59358
I20260923 19:37:46.825026 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 24308
I20260923 19:37:46.833719 24763 tablet_replica.cc:330] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: stopping tablet replica
I20260923 19:37:46.834311 24763 raft_consensus.cc:2229] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:37:46.834865 24763 raft_consensus.cc:2258] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:37:46.837412 24763 ts_tablet_manager.cc:1905] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:37:46.846729 24763 ts_tablet_manager.cc:1918] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:37:46.846957 24763 log.cc:1196] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/22642113f0c243d9a0c4e33bf6bb5c37
I20260923 19:37:46.847600 24763 ts_tablet_manager.cc:1939] T 22642113f0c243d9a0c4e33bf6bb5c37 P 50533c828e8f45458a475c1f62a6105b: Deleting consensus metadata
I20260923 19:37:46.849990 24213 catalog_manager.cc:4841] TS 50533c828e8f45458a475c1f62a6105b (127.12.159.194:45719): tablet 22642113f0c243d9a0c4e33bf6bb5c37 (table test-table [id=6b0c768e19094ebabec37b22e0a340c7]) successfully deleted
I20260923 19:37:46.851316 24764 tablet_replica.cc:330] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: stopping tablet replica
I20260923 19:37:46.851789 24765 tablet_replica.cc:330] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: stopping tablet replica
I20260923 19:37:46.852345 24765 raft_consensus.cc:2229] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:37:46.853087 24765 raft_consensus.cc:2258] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:37:46.853863 24764 raft_consensus.cc:2229] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:37:46.854378 24764 raft_consensus.cc:2258] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:37:46.855831 24765 ts_tablet_manager.cc:1905] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:37:46.857730 24764 ts_tablet_manager.cc:1905] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:37:46 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:37:46.863832 24765 ts_tablet_manager.cc:1918] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:37:46.864114 24765 log.cc:1196] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/22642113f0c243d9a0c4e33bf6bb5c37
I20260923 19:37:46.864773 24765 ts_tablet_manager.cc:1939] T 22642113f0c243d9a0c4e33bf6bb5c37 P eae8590d5d66464f9ed4b138a2030130: Deleting consensus metadata
I20260923 19:37:46.864861 24764 ts_tablet_manager.cc:1918] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:37:46.865010 24764 log.cc:1196] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/22642113f0c243d9a0c4e33bf6bb5c37
I20260923 19:37:46.865505 24764 ts_tablet_manager.cc:1939] T 22642113f0c243d9a0c4e33bf6bb5c37 P fc2da2a699e74e0d8a4d0f1aca33e058: Deleting consensus metadata
I20260923 19:37:46.867025 24213 catalog_manager.cc:4841] TS eae8590d5d66464f9ed4b138a2030130 (127.12.159.193:37235): tablet 22642113f0c243d9a0c4e33bf6bb5c37 (table test-table [id=6b0c768e19094ebabec37b22e0a340c7]) successfully deleted
I20260923 19:37:46.867215 24212 catalog_manager.cc:4841] TS fc2da2a699e74e0d8a4d0f1aca33e058 (127.12.159.195:42201): tablet 22642113f0c243d9a0c4e33bf6bb5c37 (table test-table [id=6b0c768e19094ebabec37b22e0a340c7]) successfully deleted
I20260923 19:37:46.870720 24732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.828562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33384 (local address 127.12.159.193:37235)
0923 19:37:46.829189 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.829199 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.850817 (+ 21618us) server_negotiation.cc:407] Connection header received
0923 19:37:46.851265 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.851272 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.851373 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.851522 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:46.853351 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.854595 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.856540 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.857281 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.857426 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:46.863154 (+ 5728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:46.863170 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:46.863189 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:46.863240 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:46.867735 (+ 4495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.868459 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.868468 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.868472 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.868618 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:46.868995 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:46.869001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:46.869004 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:46.869479 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:46.869798 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:46.870099 (+ 301us) server_negotiation.cc:299] Negotiation successful
0923 19:37:46.870329 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425}
I20260923 19:37:46.871440 24436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:37:46.973698 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 24308
I20260923 19:37:46.992059 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 24447
Sep 23 19:37:46 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:37:47.009430 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:46.992981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59374 (local address 127.12.159.194:45719)
0923 19:37:46.993347 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:46.993353 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:46.993383 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:37:46.993515 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:46.993521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:46.993613 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:46.993745 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:46.995236 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.996017 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.997455 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:46.998162 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:46.998314 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:47.003030 (+ 4716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:47.003055 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:47.003069 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:47.003105 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:47.006518 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:47.007270 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:47.007292 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:47.007294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:47.007419 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:47.007819 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:47.007825 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:47.007828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:47.008176 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:47.008482 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:47.008801 (+ 319us) server_negotiation.cc:299] Negotiation successful
0923 19:37:47.009013 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231}
I20260923 19:37:47.010444 24579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:37:47.101449 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 24447
I20260923 19:37:47.119714 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 24590
Sep 23 19:37:47 dist-test-slave-lzv7 krb5kdc[23752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:37:47.136150 24733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:37:47.120596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35396 (local address 127.12.159.195:42201)
0923 19:37:47.120770 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:37:47.120775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:37:47.120793 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:37:47.120951 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:37:47.120955 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:37:47.121018 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:37:47.121100 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:37:47.122505 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:47.123275 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:47.124733 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:37:47.125123 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:37:47.125290 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:37:47.129773 (+ 4483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:37:47.129788 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:37:47.129854 (+ 66us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:37:47.129913 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:37:47.132803 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:47.133728 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:47.133743 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:47.133745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:47.134139 (+ 394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:37:47.134537 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:37:47.134543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:37:47.134547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:37:47.134938 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:37:47.135263 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0923 19:37:47.135562 (+ 299us) server_negotiation.cc:299] Negotiation successful
0923 19:37:47.135792 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:37:47.136869 24713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:37:47.229079 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 24590
I20260923 19:37:47.246029 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 24196
I20260923 19:37:47.247447 24258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:37:47.361459 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 24196
I20260923 19:37:47.382575 12927 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 19:37:47.718153 12927 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 19:37:47.718405 12927 mini_ranger.cc:66] Stopping Ranger...
I20260923 19:37:48.064433 12927 mini_ranger.cc:68] Stopped Ranger
2026-09-23 19:37:48.064 UTC [23782] LOG: received smart shutdown request
2026-09-23 19:37:48.068 UTC [23782] LOG: background worker "logical replication launcher" (PID 23791) exited with exit code 1
2026-09-23 19:37:48.068 UTC [23786] LOG: shutting down
2026-09-23 19:37:48.245 UTC [23782] LOG: database system is shut down
2026-09-23T19:37:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51108 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:37:48 dist-test-slave-lzv7 krb5kdc[24779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:37:48 dist-test-slave-lzv7 krb5kdc[24779](info): set up 2 sockets
Sep 23 19:37:48 dist-test-slave-lzv7 krb5kdc[24779](info): commencing operation
krb5kdc: starting...
W20260923 19:37:49.494172 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:37:49 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:37:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:37:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/rangeradmin_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/rangeradmin_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/rangerlookup_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/rangerlookup_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
I20260923 19:37:49.825032 12927 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWWieFZ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/postgres -l logfile start
2026-09-23 19:37:52.449 UTC [24809] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 19:37:52.449 UTC [24809] LOG: listening on IPv4 address "127.12.159.212", port 48055
2026-09-23 19:37:52.452 UTC [24809] LOG: listening on Unix socket "/tmp/.s.PGSQL.48055"
2026-09-23 19:37:52.476 UTC [24812] LOG: database system was shut down at 2026-09-23 19:37:50 UTC
2026-09-23 19:37:52.479 UTC [24809] LOG: database system is ready to accept connections
I20260923 19:37:53.458317 12927 mini_postgres.cc:96] Postgres bound to 48055
2026-09-23 19:37:53.475 UTC [24820] FATAL: database "slave" does not exist
127.12.159.212:48055 - accepting connections
I20260923 19:37:53.476529 12927 mini_ranger.cc:161] Starting Ranger...
I20260923 19:37:53.504017 12927 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 19:37:53.995702 12927 mini_ranger.cc:87] Created ranger Postgres database
I20260923 19:37:53.995820 12927 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-admin
2026-09-23 19:37:54,314 [I] DB FLAVOR :POSTGRES
2026-09-23 19:37:54,315 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:37:54,315 [I] Checking connection..
2026-09-23 19:37:54,315 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 19:37:54,600 [I] Checking connection passed.
2026-09-23 19:37:54,600 [I] --------- Verifying version history table ---------
2026-09-23 19:37:54,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:37:54,894 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:37:54,895 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:37:55,147 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:37:55,147 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 19:37:55,147 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 19:37:55.410 UTC [24884] WARNING: there is no transaction in progress
2026-09-23 19:37:55,417 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 19:37:55,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:37:55,671 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 19:37:55,671 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:37:55,671 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 19:37:55,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 19:37:56,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lzv7.c.gcp-upstream.internal','N') ;"
2026-09-23 19:37:56,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:37:56,672 [I] Table x_portal_user does not exist in database ranger
2026-09-23 19:37:56,672 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:37:56,915 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 19:37:56,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:37:57,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:37:57,415 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 19:37:57,415 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 19:37:58.434 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.453 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.470 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.487 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.506 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.527 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.582 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.589 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.603 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.615 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.626 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.641 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.650 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.657 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.664 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:58.671 UTC [24992] WARNING: there is no transaction in progress
2026-09-23 19:37:59,359 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 19:37:59,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 19:37:59,609 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 19:37:59,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:37:59,857 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 19:37:59,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:38:00,120 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 19:38:00,121 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:38:00,370 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:38:00,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lzv7.c.gcp-upstream.internal';"
2026-09-23 19:38:00,890 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 19:38:00,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 19:38:01,137 [I] DB_PATCHES have already been applied
I20260923 19:38:01.144158 12927 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWWieFZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 19:38:01.144245 12927 mini_ranger.cc:193] Using host: 127.12.159.212
I20260923 19:38:01.158596 12927 mini_ranger.cc:227] Ranger admin URL: http://127.12.159.212:47361
Sep 23, 2026 7:38:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:38:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:38:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 7:38:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 7:38:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 7:38:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 7:38:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 19:38:02.307184 12927 mini_ranger.cc:160] Time spent starting Ranger: real 8.831s user 0.000s sys 0.039s
Sep 23, 2026 7:38:22 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 7:38:22 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 23, 2026 7:38:22 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 7:38:22 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 7:38:22 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 19:38:23.605324 12927 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.159.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.159.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/rangerkms_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.159.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/rangerkms_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.159.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.159.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.159.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/HTTP_127.12.159.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 19:38:23 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192303, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 19:38:23.778045 12927 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 19:38:23.800045 12927 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 19:38:24.747766 12927 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 19:38:24.747870 12927 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms
I20260923 19:38:24.747910 12927 mini_ranger_kms.cc:227] Using postgres at 127.12.159.212:48055
2026-09-23 19:38:25,106 [I] DB FLAVOR :POSTGRES
2026-09-23 19:38:25,106 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:38:25,106 [I] Checking connection
2026-09-23 19:38:25,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 19:38:25,354 [I] connection success
2026-09-23 19:38:25,354 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 19:38:25,354 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 19:38:25,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 19:38:25,628 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 19:38:25,628 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:38:25,628 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 19:38:25,628 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.159.212:48055/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 19:38:25,890 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 19:38:26.370363 12927 mini_ranger_kms.cc:310] Created kms service
I20260923 19:38:26.589596 12927 mini_ranger_kms.cc:326] Created kudu user
I20260923 19:38:26.636651 12927 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 19:38:26 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192303, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:27.054354 12927 mini_ranger_kms.cc:384] Added ranger policy
I20260923 19:38:27.054672 12927 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWWieFZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWWieFZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 19:38:27.054741 12927 mini_ranger_kms.cc:240] Using host: 127.12.159.212
I20260923 19:38:27.069974 12927 mini_ranger_kms.cc:276] Ranger KMS PID: 25172
I20260923 19:38:27.070116 12927 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.159.212:58277
Sep 23, 2026 7:38:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:38:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:38:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 7:38:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 7:38:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 7:38:28 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260923 19:38:29.433620 12927 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.656s user 0.107s sys 0.262s
I20260923 19:38:29.433948 12927 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 19:38:29.434154 12927 mini_ranger_kms.cc:401] 127.12.159.212:58277/kms/v1/keys
Sep 23 19:38:29 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192309, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.159.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 23 19:38:30 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192309, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.159.212@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
Sep 23 19:38:30 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192309, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.159.212@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
Sep 23 19:38:32 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:38:32.746559 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34473
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:34473
--ranger_config_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:33.088785 25223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:33.089085 25223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:33.089234 25223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:33.096659 25223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:33.096791 25223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:33.096864 25223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:33.096948 25223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:33.097036 25223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:33.107622 25223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.159.212:58277/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:34473
--ranger_config_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:33.109014 25223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:33.110446 25223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:33.124398 25228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:33.124428 25229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:33.125823 25223 server_base.cc:1034] running on GCE node
W20260923 19:38:33.125923 25231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:33.126998 25223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:33.128897 25223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:33.130143 25223 hybrid_clock.cc:648] HybridClock initialized: now 1790192313130089 us; error 42 us; skew 500 ppm
I20260923 19:38:33.130577 25223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:33 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192313, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:33.140787 25223 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:38:33.142635 25223 webserver.cc:460] Webserver started at http://127.12.159.254:46011/ using document root <none> and password file <none>
I20260923 19:38:33.143355 25223 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:33.143508 25223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:33.143831 25223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:38:33 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192313, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:33.195574 25223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "260303bafff845eea130f2493df29063"
format_stamp: "Formatted at 2026-09-23 19:38:33 on dist-test-slave-lzv7"
server_key: "34efbab353f703fbeb7903a57506b2ea"
server_key_iv: "af1f6b22ed64ead149907ed3c6579c42"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:33.196693 25223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "260303bafff845eea130f2493df29063"
format_stamp: "Formatted at 2026-09-23 19:38:33 on dist-test-slave-lzv7"
server_key: "34efbab353f703fbeb7903a57506b2ea"
server_key_iv: "af1f6b22ed64ead149907ed3c6579c42"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:33.203904 25223 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260923 19:38:33.226066 25238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:33.227977 25223 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260923 19:38:33.228179 25223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "260303bafff845eea130f2493df29063"
format_stamp: "Formatted at 2026-09-23 19:38:33 on dist-test-slave-lzv7"
server_key: "34efbab353f703fbeb7903a57506b2ea"
server_key_iv: "af1f6b22ed64ead149907ed3c6579c42"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:33.228448 25223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:33.248730 25223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:33.254068 25223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:33.254444 25223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:33.274889 25223 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:34473
I20260923 19:38:33.274855 25289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:34473 every 8 connection(s)
I20260923 19:38:33.276770 25223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:38:33.280797 25290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:33.281236 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 25223
I20260923 19:38:33.281453 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:38:33.282352 12927 external_mini_cluster.cc:1428] Setting key 1ec5909979dd29d1c153298f5f2c98c0
I20260923 19:38:33.300593 25290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Bootstrap starting.
I20260923 19:38:33.304311 25290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:33.305657 25290 log.cc:824] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:33.309293 25290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: No bootstrap required, opened a new log
Sep 23 19:38:33 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:33.318547 25290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:33.318989 25290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:33.319118 25290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260303bafff845eea130f2493df29063, State: Initialized, Role: FOLLOWER
I20260923 19:38:33.319801 25290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:33.320063 25290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:38:33.320241 25290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:38:33.320438 25290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:33.323271 25290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:33.323843 25290 leader_election.cc:302] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 260303bafff845eea130f2493df29063; no voters:
I20260923 19:38:33.324570 25290 leader_election.cc:288] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:38:33.324738 25295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:38:33.327577 25293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:33.284559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42818 (local address 127.12.159.254:34473)
0923 19:38:33.301443 (+ 16884us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:33.301462 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:33.301519 (+ 57us) server_negotiation.cc:407] Connection header received
0923 19:38:33.304039 (+ 2520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:33.304072 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:33.304700 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:33.305221 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:33.307069 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:33.309051 (+ 1982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:33.311011 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:33.312121 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:33.312308 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:33.317359 (+ 5051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:33.317372 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:33.317392 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:33.317443 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:33.321345 (+ 3902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:33.322262 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:33.322271 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:33.322279 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:33.322475 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:33.322897 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:33.322901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:33.322905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:33.323589 (+ 684us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:33.323889 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:33.325110 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0923 19:38:33.325717 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16586,"thread_start_us":16342,"threads_started":1}
I20260923 19:38:33.331696 25295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 LEADER]: Becoming Leader. State: Replica: 260303bafff845eea130f2493df29063, State: Running, Role: LEADER
I20260923 19:38:33.332340 25295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:33.333048 25290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:33.335611 25297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 260303bafff845eea130f2493df29063. Latest consensus state: current_term: 1 leader_uuid: "260303bafff845eea130f2493df29063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } } }
I20260923 19:38:33.335973 25297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:33.335687 25296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "260303bafff845eea130f2493df29063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } } }
I20260923 19:38:33.336194 25296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:33.339267 25300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:38:33.344871 25300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:38:33.372298 25300 catalog_manager.cc:1347] Generated new cluster ID: 9a6890d9bedd428e829b974e594792dc
I20260923 19:38:33.372443 25300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:38:33.389487 25300 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:38:33.391778 25300 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:38:33.414001 25300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Generated new TSK 0
I20260923 19:38:33.415385 25300 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:38:33.418530 25290 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:38:34.250378 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34473
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:38:34 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192314, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260923 19:38:34.699582 25336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:34.700110 25336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:34.700333 25336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:34.712283 25336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:34.712436 25336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:34.712680 25336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:38:34.728487 25336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.159.212:58277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:34.730394 25336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:34.732110 25336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:34.762892 25347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:34.763862 25346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:34.768476 25336 server_base.cc:1034] running on GCE node
W20260923 19:38:34.768537 25350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:34.769532 25336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:34.774596 25336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:34.775942 25336 hybrid_clock.cc:648] HybridClock initialized: now 1790192314775873 us; error 68 us; skew 500 ppm
I20260923 19:38:34.776386 25336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:34 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192314, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:34.780567 25336 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:38:34.782523 25336 webserver.cc:460] Webserver started at http://127.12.159.193:40753/ using document root <none> and password file <none>
I20260923 19:38:34.783488 25336 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:34.783629 25336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:34.784010 25336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:38:34 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192314, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:34.805124 25336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "e9d23ea0adc14ba79e974a93cbd78b8d"
format_stamp: "Formatted at 2026-09-23 19:38:34 on dist-test-slave-lzv7"
server_key: "b470eec5baeb279732ef3478b231e158"
server_key_iv: "482ee4e54d9eb9a90d2e3b66d8c51b24"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:34.806509 25336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "e9d23ea0adc14ba79e974a93cbd78b8d"
format_stamp: "Formatted at 2026-09-23 19:38:34 on dist-test-slave-lzv7"
server_key: "b470eec5baeb279732ef3478b231e158"
server_key_iv: "482ee4e54d9eb9a90d2e3b66d8c51b24"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:34.848152 25336 fs_manager.cc:691] Time spent creating directory manager: real 0.041s user 0.015s sys 0.025s
I20260923 19:38:34.876902 25356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:34.887512 25336 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.003s sys 0.008s
I20260923 19:38:34.887804 25336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "e9d23ea0adc14ba79e974a93cbd78b8d"
format_stamp: "Formatted at 2026-09-23 19:38:34 on dist-test-slave-lzv7"
server_key: "b470eec5baeb279732ef3478b231e158"
server_key_iv: "482ee4e54d9eb9a90d2e3b66d8c51b24"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:34.888286 25336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:34.960161 25336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:34.964708 25336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:34.965090 25336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:34.968020 25336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:34.969930 25336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:34.970031 25336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:34.970247 25336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:34.970346 25336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:38:35 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192314, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:35.122304 25336 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:41537
I20260923 19:38:35.122330 25468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:41537 every 8 connection(s)
I20260923 19:38:35.123754 25336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:38:35.129460 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 25336
I20260923 19:38:35.129726 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:38:35.130751 12927 external_mini_cluster.cc:1428] Setting key 9e5ac4ef90c10dbd18c51e52981bcb72
Sep 23 19:38:35 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192314, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:35.173022 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:35.127134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:46167 (local address 127.12.159.254:34473)
0923 19:38:35.153000 (+ 25866us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:35.153008 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:35.154775 (+ 1767us) server_negotiation.cc:407] Connection header received
0923 19:38:35.156913 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:35.156922 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:35.157036 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:35.157153 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:35.159141 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.160055 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.161784 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.162297 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.162457 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:35.166334 (+ 3877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:35.166340 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:35.166343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:35.166381 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:35.169351 (+ 2970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:35.170416 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:35.170421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:35.170423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:35.170556 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:35.171060 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:35.171064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:35.171066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:35.171387 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:35.171559 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:35.172322 (+ 763us) server_negotiation.cc:299] Negotiation successful
0923 19:38:35.172563 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25713,"thread_start_us":25574,"threads_started":1}
I20260923 19:38:35.174172 25472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:35.127867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34473 (local address 127.12.159.193:46167)
0923 19:38:35.153916 (+ 26049us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:35.153976 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:35.156534 (+ 2558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:35.157447 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:35.157459 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:35.158118 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:35.158924 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:35.158949 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.160250 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.160258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:35.161589 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:35.161602 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.162561 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.162571 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:35.162850 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:35.163636 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:35.163662 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:35.166065 (+ 2403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:35.169527 (+ 3462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:35.169538 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:35.169557 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:35.170264 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:35.170681 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:35.170686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:35.170690 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:35.170907 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:35.171530 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:35.171539 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:35.171932 (+ 393us) client_negotiation.cc:769] Sending connection context
0923 19:38:35.172232 (+ 300us) client_negotiation.cc:240] Negotiation successful
0923 19:38:35.172789 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25666,"thread_start_us":25395,"threads_started":1}
I20260923 19:38:35.176052 25469 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34473
I20260923 19:38:35.176450 25469 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:35.177233 25469 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:38:35.179919 25255 ts_manager.cc:194] Registered new tserver with Master: e9d23ea0adc14ba79e974a93cbd78b8d (127.12.159.193:41537)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
I20260923 19:38:35.182363 25255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:46167
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:38:35.213354 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34473
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:38:35 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192314, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
W20260923 19:38:35.667856 25475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:35.668198 25475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:35.668366 25475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:35.676337 25475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:35.676497 25475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:35.676677 25475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:38:35.687233 25475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.159.212:58277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:35.688701 25475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:35.690208 25475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:35.704341 25490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:35.704514 25492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:35.704953 25489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:35.705363 25475 server_base.cc:1034] running on GCE node
I20260923 19:38:35.706189 25475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:35.707474 25475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:35.708745 25475 hybrid_clock.cc:648] HybridClock initialized: now 1790192315708674 us; error 53 us; skew 500 ppm
I20260923 19:38:35.709123 25475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:35 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:35.713039 25475 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:38:35.714713 25475 webserver.cc:460] Webserver started at http://127.12.159.194:38507/ using document root <none> and password file <none>
I20260923 19:38:35.715488 25475 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:35.715646 25475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:35.715965 25475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:38:35 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:35.734128 25475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "c109cb540e5b4afbad9a6ed46ee2de7d"
format_stamp: "Formatted at 2026-09-23 19:38:35 on dist-test-slave-lzv7"
server_key: "26652ef8226156d5da9ca3ca0cce1f7a"
server_key_iv: "445e38c6eaf952ed68494e2cdedd8c35"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:35.735342 25475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "c109cb540e5b4afbad9a6ed46ee2de7d"
format_stamp: "Formatted at 2026-09-23 19:38:35 on dist-test-slave-lzv7"
server_key: "26652ef8226156d5da9ca3ca0cce1f7a"
server_key_iv: "445e38c6eaf952ed68494e2cdedd8c35"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:35.742399 25475 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.004s
I20260923 19:38:35.770568 25499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:35.772770 25475 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.007s sys 0.008s
I20260923 19:38:35.772984 25475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "c109cb540e5b4afbad9a6ed46ee2de7d"
format_stamp: "Formatted at 2026-09-23 19:38:35 on dist-test-slave-lzv7"
server_key: "26652ef8226156d5da9ca3ca0cce1f7a"
server_key_iv: "445e38c6eaf952ed68494e2cdedd8c35"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:35.773247 25475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:35.795120 25475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:35.800452 25475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:35.800838 25475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:35.802093 25475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:35.803900 25475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:35.804023 25475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260923 19:38:35.804176 25475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:35.804260 25475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:35.848095 25475 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:33749
I20260923 19:38:35.848112 25611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:33749 every 8 connection(s)
I20260923 19:38:35.849619 25475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:38:35.856747 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 25475
I20260923 19:38:35.856935 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:38:35.857488 12927 external_mini_cluster.cc:1428] Setting key 0c4f04d2084b7cfff0b689e026e43550
Sep 23 19:38:35 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:35.876500 25614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:35.852977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:47025 (local address 127.12.159.254:34473)
0923 19:38:35.853506 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:35.853511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:35.854626 (+ 1115us) server_negotiation.cc:407] Connection header received
0923 19:38:35.856956 (+ 2330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:35.856962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:35.857082 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:35.857209 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:35.859283 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.860438 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.863400 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.864080 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.864218 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:35.869326 (+ 5108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:35.869333 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:35.869336 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:35.869380 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:35.872756 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:35.873625 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:35.873631 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:35.873633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:35.873796 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:35.874375 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:35.874380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:35.874384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:35.874695 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:35.874894 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:35.875823 (+ 929us) server_negotiation.cc:299] Negotiation successful
0923 19:38:35.876084 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":290,"threads_started":1}
I20260923 19:38:35.877672 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:35.853500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34473 (local address 127.12.159.194:47025)
0923 19:38:35.854458 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:35.854499 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:35.856507 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:35.857491 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:35.857500 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:35.858184 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:35.859076 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:35.859105 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.860619 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.860628 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:35.863199 (+ 2571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:35.863220 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:35.864382 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:35.864393 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:35.864779 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:35.865838 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:35.865878 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:35.869073 (+ 3195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:35.872927 (+ 3854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:35.872937 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:35.872957 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:35.873460 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:35.873999 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:35.874005 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:35.874009 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:35.874240 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:35.874859 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:35.874868 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:35.875322 (+ 454us) client_negotiation.cc:769] Sending connection context
0923 19:38:35.875676 (+ 354us) client_negotiation.cc:240] Negotiation successful
0923 19:38:35.876291 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":456,"threads_started":1}
I20260923 19:38:35.879492 25612 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34473
I20260923 19:38:35.879877 25612 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:35.880779 25612 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
I20260923 19:38:35.882637 25255 ts_manager.cc:194] Registered new tserver with Master: c109cb540e5b4afbad9a6ed46ee2de7d (127.12.159.194:33749)
I20260923 19:38:35.883620 25255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:47025
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:38:35.922050 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34473
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:38:36.186758 25469 heartbeater.cc:503] Master 127.12.159.254:34473 was elected leader, sending a full tablet report...
W20260923 19:38:36.286819 25618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:36.287206 25618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:36.287398 25618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:36.295142 25618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:36.295296 25618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:36.295536 25618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:38:36.307113 25618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.159.212:58277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:36.308544 25618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:36.310141 25618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:36.324172 25626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:36.324203 25624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:36.324522 25623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:36.325532 25618 server_base.cc:1034] running on GCE node
I20260923 19:38:36.326236 25618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:36.327278 25618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:36.328505 25618 hybrid_clock.cc:648] HybridClock initialized: now 1790192316328475 us; error 61 us; skew 500 ppm
I20260923 19:38:36.328883 25618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:36 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:36.332098 25618 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:38:36.333734 25618 webserver.cc:460] Webserver started at http://127.12.159.195:37613/ using document root <none> and password file <none>
I20260923 19:38:36.334635 25618 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:36.334806 25618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:36.335155 25618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:38:36 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:36.352105 25618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "9af43ce232194861bd74e78680160179"
format_stamp: "Formatted at 2026-09-23 19:38:36 on dist-test-slave-lzv7"
server_key: "3770ba1c2ce6e12dfbb4c51c150a4178"
server_key_iv: "f663ee47a1ed9745330ebda039873179"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:36.352937 25618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "9af43ce232194861bd74e78680160179"
format_stamp: "Formatted at 2026-09-23 19:38:36 on dist-test-slave-lzv7"
server_key: "3770ba1c2ce6e12dfbb4c51c150a4178"
server_key_iv: "f663ee47a1ed9745330ebda039873179"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:36.358433 25618 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:38:36.376833 25633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:36.378624 25618 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260923 19:38:36.378823 25618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "9af43ce232194861bd74e78680160179"
format_stamp: "Formatted at 2026-09-23 19:38:36 on dist-test-slave-lzv7"
server_key: "3770ba1c2ce6e12dfbb4c51c150a4178"
server_key_iv: "f663ee47a1ed9745330ebda039873179"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:36.379096 25618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:36.395182 25618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:36.399389 25618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:36.399689 25618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:36.400668 25618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:36.402143 25618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:36.402252 25618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:36.402405 25618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:36.402490 25618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:36.439656 25618 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:39723
I20260923 19:38:36.439692 25745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:39723 every 8 connection(s)
I20260923 19:38:36.440975 25618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:38:36.450212 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 25618
I20260923 19:38:36.450392 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:38:36.450891 12927 external_mini_cluster.cc:1428] Setting key 1d5a903606cccb07d19eef363f206b52
Sep 23 19:38:36 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:36.462096 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:36.443934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:51619 (local address 127.12.159.254:34473)
0923 19:38:36.444447 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:36.444453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:36.445232 (+ 779us) server_negotiation.cc:407] Connection header received
0923 19:38:36.447066 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:36.447070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:36.447143 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:36.447243 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:36.448815 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.449545 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.451471 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.452097 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.452221 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:36.456032 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:36.456037 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:36.456041 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:36.456076 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:36.458948 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.459728 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.459735 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.459739 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.459892 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.460394 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.460398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.460400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.460680 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:36.460833 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:36.461581 (+ 748us) server_negotiation.cc:299] Negotiation successful
0923 19:38:36.461753 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":234,"threads_started":1}
I20260923 19:38:36.463060 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:36.444308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34473 (local address 127.12.159.195:51619)
0923 19:38:36.445072 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:36.445111 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:36.446802 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:36.447496 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:36.447505 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:36.447967 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:36.448600 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:36.448618 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.449701 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.449705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:36.451303 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:36.451315 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.452324 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.452336 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:36.452528 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:36.453265 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:36.453288 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:36.455775 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:36.459102 (+ 3327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:36.459108 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:36.459120 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:36.459577 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:36.460043 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:36.460047 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:36.460049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:36.460264 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:36.460878 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:36.460884 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:36.461220 (+ 336us) client_negotiation.cc:769] Sending connection context
0923 19:38:36.461453 (+ 233us) client_negotiation.cc:240] Negotiation successful
0923 19:38:36.461939 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":325,"threads_started":1}
I20260923 19:38:36.464715 25746 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34473
I20260923 19:38:36.465044 25746 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:36.465948 25746 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
I20260923 19:38:36.467505 25255 ts_manager.cc:194] Registered new tserver with Master: 9af43ce232194861bd74e78680160179 (127.12.159.195:39723)
I20260923 19:38:36.468334 25255 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:51619
I20260923 19:38:36.479259 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:38:36.481168 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 25336
Sep 23 19:38:36 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:38:36.498914 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:36.482390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36730 (local address 127.12.159.193:41537)
0923 19:38:36.483136 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:36.483143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:36.483169 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:38:36.483228 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:36.483235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:36.483529 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:36.483670 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:36.485275 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.486461 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.487887 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.488492 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.488603 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:36.492918 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:36.492932 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:36.492946 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:36.492987 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:36.496219 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.496873 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.496880 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.496882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.497046 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.497440 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.497444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.497446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.497792 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:36.498096 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:36.498371 (+ 275us) server_negotiation.cc:299] Negotiation successful
0923 19:38:36.498578 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":386,"threads_started":1}
I20260923 19:38:36.500162 25464 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:36.589421 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 25336
I20260923 19:38:36.605567 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 25475
Sep 23 19:38:36 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:38:36.622218 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:36.606595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34756 (local address 127.12.159.194:33749)
0923 19:38:36.607202 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:36.607212 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:36.607244 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:38:36.607321 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:36.607328 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:36.607550 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:36.607726 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:36.609151 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.610353 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.611861 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.612490 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.612607 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:36.616846 (+ 4239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:36.616858 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:36.616896 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:36.616937 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:36.619671 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.620272 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.620279 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.620281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.620415 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.620727 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.620730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.620732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.621071 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:36.621284 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:36.621523 (+ 239us) server_negotiation.cc:299] Negotiation successful
0923 19:38:36.621722 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":338,"threads_started":1}
I20260923 19:38:36.623510 25607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:36.709026 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 25475
I20260923 19:38:36.729565 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 25618
Sep 23 19:38:36 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:38:36.746415 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:36.730617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36716 (local address 127.12.159.195:39723)
0923 19:38:36.731335 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:36.731342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:36.731371 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:38:36.731432 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:36.731438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:36.731654 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:36.731785 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:36.733099 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.734468 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.735901 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:36.736413 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:36.736505 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:36.740978 (+ 4473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:36.740991 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:36.741006 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:36.741044 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:36.743943 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.744647 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.744654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.744656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.744775 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:36.745080 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:36.745082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:36.745084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:36.745411 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:36.745635 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:36.745947 (+ 312us) server_negotiation.cc:299] Negotiation successful
0923 19:38:36.746139 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":415,"threads_started":1}
I20260923 19:38:36.748760 25741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:36.853056 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 25618
I20260923 19:38:36.868646 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 25223
I20260923 19:38:36.870054 25285 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:36.981204 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 25223
I20260923 19:38:37.003681 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34473
--webserver_interface=127.12.159.254
--webserver_port=46011
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:34473
--ranger_config_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:37.340495 25758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:37.340873 25758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:37.340971 25758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:37.348572 25758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:37.348711 25758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:37.348765 25758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:37.348829 25758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:37.348877 25758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:37.359509 25758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:34473
--ranger_config_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=46011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:37.360886 25758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:37.362287 25758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:37.375393 25763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:37.375283 25764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:37.375345 25766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:37.376223 25758 server_base.cc:1034] running on GCE node
I20260923 19:38:37.377089 25758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:37.378681 25758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:37.379957 25758 hybrid_clock.cc:648] HybridClock initialized: now 1790192317379902 us; error 62 us; skew 500 ppm
I20260923 19:38:37.380405 25758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:37 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192317, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:37.384128 25758 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:38:37.385712 25758 webserver.cc:460] Webserver started at http://127.12.159.254:46011/ using document root <none> and password file <none>
I20260923 19:38:37.386448 25758 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:37.386598 25758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:38:37 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192317, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:37.441737 25758 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:38:37.445158 25774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:37.446753 25758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:37.446956 25758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "260303bafff845eea130f2493df29063"
format_stamp: "Formatted at 2026-09-23 19:38:33 on dist-test-slave-lzv7"
server_key: "34efbab353f703fbeb7903a57506b2ea"
server_key_iv: "af1f6b22ed64ead149907ed3c6579c42"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:37.447950 25758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:37.468315 25758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:37.472760 25758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:37.473074 25758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:37.492306 25758 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:34473
I20260923 19:38:37.492326 25825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:34473 every 8 connection(s)
I20260923 19:38:37.493978 25758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:38:37.496413 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 25758
I20260923 19:38:37.497285 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:41537
--local_ip_for_outbound_sockets=127.12.159.193
--tserver_master_addrs=127.12.159.254:34473
--webserver_port=40753
--webserver_interface=127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:38:37.501037 25826 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:38:37.504667 25826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Bootstrap starting.
I20260923 19:38:37.527717 25826 log.cc:824] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:37.536801 25826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:38:37.537356 25826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Bootstrap complete.
I20260923 19:38:37.546770 25826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:37.547614 25826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260303bafff845eea130f2493df29063, State: Initialized, Role: FOLLOWER
I20260923 19:38:37.548285 25826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:37.548513 25826 raft_consensus.cc:388] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:38:37.548632 25826 raft_consensus.cc:482] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:38:37.548828 25826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:38:37.553102 25826 raft_consensus.cc:504] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:37.553637 25826 leader_election.cc:302] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 260303bafff845eea130f2493df29063; no voters:
I20260923 19:38:37.554311 25826 leader_election.cc:288] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:38:37.554461 25830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:38:37.556738 25826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:37.558561 25830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [term 2 LEADER]: Becoming Leader. State: Replica: 260303bafff845eea130f2493df29063, State: Running, Role: LEADER
I20260923 19:38:37.559367 25830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } }
I20260923 19:38:37.562721 25832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 260303bafff845eea130f2493df29063. Latest consensus state: current_term: 2 leader_uuid: "260303bafff845eea130f2493df29063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } } }
I20260923 19:38:37.563206 25832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:37.563827 25831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "260303bafff845eea130f2493df29063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260303bafff845eea130f2493df29063" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34473 } } }
I20260923 19:38:37.564149 25831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:37.566399 25841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:38:37.579797 25841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:38:37.581758 25841 catalog_manager.cc:1259] Loaded cluster ID: 9a6890d9bedd428e829b974e594792dc
I20260923 19:38:37.582023 25841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:38:37.587271 25841 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:38:37.589341 25841 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Loaded TSK: 0
I20260923 19:38:37.591459 25841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:38:37.594806 25826 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260923 19:38:37.958153 25828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:37.958683 25828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:37.958899 25828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:37.971302 25828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:37.971441 25828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:37.971683 25828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:38:37.987525 25828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:41537
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=40753
--tserver_master_addrs=127.12.159.254:34473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:37.989234 25828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:37.991055 25828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:38.044916 25865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:38.047384 25864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:38.051962 25828 server_base.cc:1034] running on GCE node
W20260923 19:38:38.053282 25867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:38.054291 25828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:38.055661 25828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:38.057040 25828 hybrid_clock.cc:648] HybridClock initialized: now 1790192318056961 us; error 70 us; skew 500 ppm
I20260923 19:38:38.057433 25828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:38 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:38.061949 25828 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:38:38.074571 25828 webserver.cc:460] Webserver started at http://127.12.159.193:40753/ using document root <none> and password file <none>
I20260923 19:38:38.075757 25828 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:38.076013 25828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:38:38 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:38.131425 25828 fs_manager.cc:709] Time spent opening directory manager: real 0.029s user 0.014s sys 0.013s
I20260923 19:38:38.146831 25876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:38.152761 25828 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.008s sys 0.008s
I20260923 19:38:38.153120 25828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "e9d23ea0adc14ba79e974a93cbd78b8d"
format_stamp: "Formatted at 2026-09-23 19:38:34 on dist-test-slave-lzv7"
server_key: "b470eec5baeb279732ef3478b231e158"
server_key_iv: "482ee4e54d9eb9a90d2e3b66d8c51b24"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:38.154712 25828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:38.204836 25828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:38.210433 25828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:38.210791 25828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:38.212164 25828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:38.214912 25828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:38.215032 25828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:38.215139 25828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:38.215210 25828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:38.273658 25828 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:41537
I20260923 19:38:38.273701 25988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:41537 every 8 connection(s)
I20260923 19:38:38.275199 25828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:38:38.284005 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 25828
I20260923 19:38:38.284878 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:33749
--local_ip_for_outbound_sockets=127.12.159.194
--tserver_master_addrs=127.12.159.254:34473
--webserver_port=38507
--webserver_interface=127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:38:38 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:38.308575 25992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:38.279217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34473 (local address 127.12.159.193:56573)
0923 19:38:38.283661 (+ 4444us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:38.283723 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:38.286047 (+ 2324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:38.287602 (+ 1555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:38.287613 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:38.288253 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:38.288872 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:38.288889 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:38.290670 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:38.290678 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:38.292384 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:38.292396 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:38.293571 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:38.293580 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:38.293936 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:38.295659 (+ 1723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:38.295682 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:38.298270 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:38.303137 (+ 4867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:38.303147 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:38.303163 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:38.303782 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:38.304350 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:38.304355 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:38.304359 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:38.304619 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:38.305754 (+ 1135us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:38.305762 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:38.306209 (+ 447us) client_negotiation.cc:769] Sending connection context
0923 19:38:38.306533 (+ 324us) client_negotiation.cc:240] Negotiation successful
0923 19:38:38.307132 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4128,"thread_start_us":3904,"threads_started":1}
I20260923 19:38:38.316753 25991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:38.279122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:56573 (local address 127.12.159.254:34473)
0923 19:38:38.284614 (+ 5492us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:38.284633 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:38.284687 (+ 54us) server_negotiation.cc:407] Connection header received
0923 19:38:38.286695 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:38.286708 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:38.287081 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:38.287466 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:38.289086 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:38.290492 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:38.292528 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:38.293287 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:38.294531 (+ 1244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:38.298605 (+ 4074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:38.298616 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:38.298635 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:38.298680 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:38.302941 (+ 4261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:38.303961 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:38.303970 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:38.303979 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:38.304180 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:38.304760 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:38.304765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:38.304768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:38.305439 (+ 671us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:38.305670 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:38.314434 (+ 8764us) server_negotiation.cc:299] Negotiation successful
0923 19:38:38.314980 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5208,"thread_start_us":5514,"threads_started":1}
I20260923 19:38:38.320933 25989 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34473
I20260923 19:38:38.321261 25989 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:38.322189 25989 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
W20260923 19:38:38.325416 25989 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:34473 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:38:38.325624 25989 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:38.326040 25989 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
I20260923 19:38:38.327284 25989 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:38.327621 25989 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
W20260923 19:38:38.328718 25989 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 19:38:38.805938 25993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:38.806399 25993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:38.806591 25993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:38.819681 25993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:38.819844 25993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:38.820108 25993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
Sep 23 19:38:38 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:38.837400 25993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:33749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=38507
--tserver_master_addrs=127.12.159.254:34473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:38.839178 25993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:38.840991 25993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:38.876256 26010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:38.877610 26009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:38.886541 26012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:38.887099 25993 server_base.cc:1034] running on GCE node
I20260923 19:38:38.887926 25993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:38.889406 25993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:38.890652 25993 hybrid_clock.cc:648] HybridClock initialized: now 1790192318890579 us; error 61 us; skew 500 ppm
I20260923 19:38:38.891144 25993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:38 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:38.895376 25993 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:38:38.897373 25993 webserver.cc:460] Webserver started at http://127.12.159.194:38507/ using document root <none> and password file <none>
I20260923 19:38:38.898379 25993 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:38.898531 25993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:38:38 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:38.923143 25993 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:38:38.926788 26021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:38.928632 25993 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:38:38.928818 25993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "c109cb540e5b4afbad9a6ed46ee2de7d"
format_stamp: "Formatted at 2026-09-23 19:38:35 on dist-test-slave-lzv7"
server_key: "26652ef8226156d5da9ca3ca0cce1f7a"
server_key_iv: "445e38c6eaf952ed68494e2cdedd8c35"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:38.930297 25993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:38.954433 25993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:38.960367 25993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:38.960770 25993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:38.962132 25993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:38.964020 25993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:38.964130 25993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:38.964252 25993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:38.964332 25993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:39.022680 25993 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:33749
I20260923 19:38:39.022728 26133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:33749 every 8 connection(s)
I20260923 19:38:39.024744 25993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:38:39.028985 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 25993
I20260923 19:38:39.029996 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.159.212:58277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:39723
--local_ip_for_outbound_sockets=127.12.159.195
--tserver_master_addrs=127.12.159.254:34473
--webserver_port=37613
--webserver_interface=127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:38:39 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:39.096335 26137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.058248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:41635 (local address 127.12.159.254:34473)
0923 19:38:39.074998 (+ 16750us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:39.075003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:39.075022 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:38:39.075077 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:39.075080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:39.075146 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:39.075367 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:39.077626 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.079001 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.082388 (+ 3387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.083307 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.083442 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.088809 (+ 5367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:39.088816 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:39.088821 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:39.088862 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:39.092446 (+ 3584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.093446 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.093454 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.093458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.093619 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.094198 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.094216 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.094220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.094569 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:39.094705 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:39.095677 (+ 972us) server_negotiation.cc:299] Negotiation successful
0923 19:38:39.095908 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16623,"thread_start_us":16483,"threads_started":1}
I20260923 19:38:39.099045 26138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.058798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34473 (local address 127.12.159.194:41635)
0923 19:38:39.070517 (+ 11719us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:39.070583 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:39.074069 (+ 3486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:39.075656 (+ 1587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:39.075673 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:39.076424 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:39.077370 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.077400 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.079276 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.079282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.081798 (+ 2516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.082000 (+ 202us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.083889 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.083897 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.084289 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.085181 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:39.085235 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:39.088535 (+ 3300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:39.092622 (+ 4087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:39.092632 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:39.092653 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:39.093290 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:39.093779 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:39.093784 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:39.093788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:39.094070 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:39.094797 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:39.094805 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:39.095257 (+ 452us) client_negotiation.cc:769] Sending connection context
0923 19:38:39.096875 (+ 1618us) client_negotiation.cc:240] Negotiation successful
0923 19:38:39.097469 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11366,"thread_start_us":11084,"threads_started":1}
I20260923 19:38:39.101037 26134 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34473
I20260923 19:38:39.101363 26134 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:39.102427 26134 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
I20260923 19:38:39.104537 25791 ts_manager.cc:194] Registered new tserver with Master: c109cb540e5b4afbad9a6ed46ee2de7d (127.12.159.194:33749)
I20260923 19:38:39.106490 25791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:41635
Sep 23 19:38:39 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:39.328884 25989 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:39.329347 25989 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
I20260923 19:38:39.330663 25791 ts_manager.cc:194] Registered new tserver with Master: e9d23ea0adc14ba79e974a93cbd78b8d (127.12.159.193:41537)
I20260923 19:38:39.331861 25791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:56573
W20260923 19:38:39.500820 26135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:39.501192 26135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:39.501340 26135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:39.512428 26135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:39.512573 26135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:39.512748 26135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:38:39.528149 26135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.159.212:58277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:39723
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=37613
--tserver_master_addrs=127.12.159.254:34473
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:39.529836 26135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:39.531561 26135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:39.559794 26145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:39.561425 26147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:39.562194 26143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:39.564205 26135 server_base.cc:1034] running on GCE node
I20260923 19:38:39.565028 26135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:39.566401 26135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:39.567651 26135 hybrid_clock.cc:648] HybridClock initialized: now 1790192319567590 us; error 47 us; skew 500 ppm
I20260923 19:38:39.568075 26135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:39 dist-test-slave-lzv7 krb5kdc[24779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:39.572126 26135 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
Sep 23 19:38:39 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:39.583760 26135 webserver.cc:460] Webserver started at http://127.12.159.195:37613/ using document root <none> and password file <none>
I20260923 19:38:39.584739 26135 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:39.584900 26135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:38:39 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for HTTP/127.12.159.212@KRBTEST.COM
I20260923 19:38:39.670995 26135 fs_manager.cc:709] Time spent opening directory manager: real 0.039s user 0.019s sys 0.008s
I20260923 19:38:39.689685 26155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:39.691793 26135 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.010s sys 0.009s
I20260923 19:38:39.691979 26135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "9af43ce232194861bd74e78680160179"
format_stamp: "Formatted at 2026-09-23 19:38:36 on dist-test-slave-lzv7"
server_key: "3770ba1c2ce6e12dfbb4c51c150a4178"
server_key_iv: "f663ee47a1ed9745330ebda039873179"
server_key_version: "kuduclusterkey@0"
I20260923 19:38:39.693331 26135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:39.787822 26135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:39.793507 26135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:39.793874 26135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:39.795166 26135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:39.796873 26135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:39.796993 26135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:39.797093 26135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:39.797165 26135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:39.853652 26135 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:39723
I20260923 19:38:39.853835 26269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:39723 every 8 connection(s)
I20260923 19:38:39.855561 26135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:38:39.862330 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26135
Sep 23 19:38:39 dist-test-slave-lzv7 krb5kdc[24779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:39.886646 26274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.860044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:33823 (local address 127.12.159.254:34473)
0923 19:38:39.862449 (+ 2405us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:39.862458 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:39.864160 (+ 1702us) server_negotiation.cc:407] Connection header received
0923 19:38:39.867946 (+ 3786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:39.867955 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:39.868063 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:39.868163 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:39.870853 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.872629 (+ 1776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.874733 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.875375 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.875509 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.879498 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:39.879504 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:39.879509 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:39.879557 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:39.883110 (+ 3553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.883867 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.883877 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.883879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.883988 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.884450 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.884458 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.884462 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.884840 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:39.884985 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:39.885999 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0923 19:38:39.886230 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2249,"thread_start_us":3922,"threads_started":1}
I20260923 19:38:39.887928 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.859397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34473 (local address 127.12.159.195:33823)
0923 19:38:39.862760 (+ 3363us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:39.862830 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:39.867339 (+ 4509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:39.868945 (+ 1606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:39.868962 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:39.869851 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:39.870641 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.870662 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.872802 (+ 2140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.872818 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.874538 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.874562 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.875624 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.875631 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.875879 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.876641 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:39.876665 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:39.879262 (+ 2597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:39.883268 (+ 4006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:39.883277 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:39.883297 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:39.883725 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:39.884101 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:39.884106 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:39.884110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:39.884322 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:39.885064 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:39.885075 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:39.885504 (+ 429us) client_negotiation.cc:769] Sending connection context
0923 19:38:39.885908 (+ 404us) client_negotiation.cc:240] Negotiation successful
0923 19:38:39.886474 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2522,"thread_start_us":3535,"threads_started":1}
I20260923 19:38:39.888142 26277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.863316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49586 (local address 127.12.159.254:34473)
0923 19:38:39.871302 (+ 7986us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:39.871320 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:39.871337 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:38:39.871402 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:39.871408 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:39.871501 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:39.871610 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:39.873706 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.874892 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.876883 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.877538 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.877665 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.881067 (+ 3402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:39.881075 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:39.881082 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:39.881137 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:39.884394 (+ 3257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.885153 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.885159 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.885162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.885304 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.885746 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.885752 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.885756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.886102 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:39.886363 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:39.887442 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0923 19:38:39.887638 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7856,"thread_start_us":7681,"threads_started":1}
I20260923 19:38:39.889866 26270 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34473
I20260923 19:38:39.890193 26270 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:39.890916 26270 heartbeater.cc:511] Master 127.12.159.254:34473 requested a full tablet report, sending...
I20260923 19:38:39.892572 25790 ts_manager.cc:194] Registered new tserver with Master: 9af43ce232194861bd74e78680160179 (127.12.159.195:39723)
I20260923 19:38:39.893784 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:38:39.893769 25790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:33823
I20260923 19:38:39.912112 26277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.897449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49590 (local address 127.12.159.254:34473)
0923 19:38:39.897653 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:39.897659 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:39.898185 (+ 526us) server_negotiation.cc:407] Connection header received
0923 19:38:39.898299 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:39.898305 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:39.898392 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:39.898497 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:39.900164 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.901260 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.902772 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.903441 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.903574 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.906094 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:39.906100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:39.906105 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:39.906143 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:39.909437 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.910169 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.910175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.910179 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.910331 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:39.910690 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:39.910695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:39.910699 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:39.911059 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:39.911300 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:39.911550 (+ 250us) server_negotiation.cc:299] Negotiation successful
0923 19:38:39.911769 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:38:39.917265 25790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:38:39.924924 25790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:38:39.966313 26293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.941002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.12.159.194:33749)
0923 19:38:39.954445 (+ 13443us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:39.954459 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:39.956062 (+ 1603us) server_negotiation.cc:407] Connection header received
0923 19:38:39.956845 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:39.956854 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:39.957176 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:39.957345 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:39.958788 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.960491 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.963514 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.965061 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.965230 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.965438 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:39.965759 (+ 321us) server_negotiation.cc:299] Negotiation successful
0923 19:38:39.965974 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13158,"thread_start_us":13000,"threads_started":1}
I20260923 19:38:39.966321 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.939999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:33749 (local address 127.0.0.1:44016)
0923 19:38:39.955844 (+ 15845us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:39.955914 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:39.956549 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:39.957704 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:39.957715 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:39.957744 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:39.958607 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.958619 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.960629 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.960635 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.963311 (+ 2676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.963327 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.965275 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.965283 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.965480 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.965534 (+ 54us) client_negotiation.cc:769] Sending connection context
0923 19:38:39.965669 (+ 135us) client_negotiation.cc:240] Negotiation successful
0923 19:38:39.965892 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15488,"mutex_wait_us":107,"thread_start_us":16283,"threads_started":1}
I20260923 19:38:39.967095 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.940524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54752 (local address 127.12.159.193:41537)
0923 19:38:39.955060 (+ 14536us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:39.955072 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:39.956842 (+ 1770us) server_negotiation.cc:407] Connection header received
0923 19:38:39.957114 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:39.957121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:39.957329 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:39.957468 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:39.959398 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.961048 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.963788 (+ 2740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.965167 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.965326 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.965455 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:39.966581 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0923 19:38:39.966751 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14321,"thread_start_us":14123,"threads_started":1}
I20260923 19:38:39.967336 26294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.956184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:39723 (local address 127.0.0.1:58876)
0923 19:38:39.959216 (+ 3032us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:39.959239 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:39.959357 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:39.960236 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:39.960240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:39.960265 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:39.960691 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.960706 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.962745 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.962750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.964535 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.964546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.966478 (+ 1932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.966486 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.966640 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.966669 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:38:39.966754 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 19:38:39.966897 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2869,"mutex_wait_us":55,"thread_start_us":2683,"threads_started":1}
I20260923 19:38:39.967823 26290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.940208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41537 (local address 127.0.0.1:54752)
0923 19:38:39.956734 (+ 16526us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:39.956753 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:39.956949 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:39.957732 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:39.957736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:39.957751 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:39.959165 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.959177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.961236 (+ 2059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.961242 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.963614 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:39.963629 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.965604 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.965608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:39.965793 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.965842 (+ 49us) client_negotiation.cc:769] Sending connection context
0923 19:38:39.965914 (+ 72us) client_negotiation.cc:240] Negotiation successful
0923 19:38:39.967377 (+ 1463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16390,"mutex_wait_us":5,"thread_start_us":15085,"threads_started":1}
I20260923 19:38:39.968343 26295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:39.956536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.12.159.195:39723)
0923 19:38:39.958533 (+ 1997us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:39.958543 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:39.959478 (+ 935us) server_negotiation.cc:407] Connection header received
0923 19:38:39.959569 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:39.959576 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:39.959818 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:39.960002 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:39.960908 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.962575 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.964684 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:39.965978 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:39.966151 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:39.966318 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:39.967587 (+ 1269us) server_negotiation.cc:299] Negotiation successful
0923 19:38:39.967764 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1785,"thread_start_us":1611,"threads_started":1}
I20260923 19:38:39.971514 26203 tablet_service.cc:1467] Processing CreateTablet for tablet 02f5ce25b02f430a946aaa46ec22c25c (DEFAULT_TABLE table=test-table [id=2d84723097464451b31cc71bf06bcd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:39.971530 25924 tablet_service.cc:1467] Processing CreateTablet for tablet 02f5ce25b02f430a946aaa46ec22c25c (DEFAULT_TABLE table=test-table [id=2d84723097464451b31cc71bf06bcd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:39.971530 26069 tablet_service.cc:1467] Processing CreateTablet for tablet 02f5ce25b02f430a946aaa46ec22c25c (DEFAULT_TABLE table=test-table [id=2d84723097464451b31cc71bf06bcd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:39.972779 26203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02f5ce25b02f430a946aaa46ec22c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:39.972829 26069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02f5ce25b02f430a946aaa46ec22c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:39.972846 25924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02f5ce25b02f430a946aaa46ec22c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:39.985131 26296 tablet_bootstrap.cc:492] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Bootstrap starting.
I20260923 19:38:39.988029 26297 tablet_bootstrap.cc:492] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Bootstrap starting.
I20260923 19:38:39.989797 26296 tablet_bootstrap.cc:654] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:39.990587 26298 tablet_bootstrap.cc:492] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Bootstrap starting.
I20260923 19:38:39.991369 26296 log.cc:824] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:39.994115 26298 tablet_bootstrap.cc:654] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:39.994134 26297 tablet_bootstrap.cc:654] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:39.994232 26296 tablet_bootstrap.cc:492] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: No bootstrap required, opened a new log
I20260923 19:38:39.994522 26296 ts_tablet_manager.cc:1397] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260923 19:38:39.995383 26298 log.cc:824] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:39.995373 26297 log.cc:824] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:40.002141 26296 raft_consensus.cc:348] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.002652 26296 raft_consensus.cc:374] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:40.002760 26296 raft_consensus.cc:729] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af43ce232194861bd74e78680160179, State: Initialized, Role: FOLLOWER
I20260923 19:38:40.003382 26296 consensus_queue.cc:260] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.004777 26297 tablet_bootstrap.cc:492] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: No bootstrap required, opened a new log
I20260923 19:38:40.004779 26298 tablet_bootstrap.cc:492] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: No bootstrap required, opened a new log
I20260923 19:38:40.005066 26298 ts_tablet_manager.cc:1397] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260923 19:38:40.005067 26297 ts_tablet_manager.cc:1397] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.003s
I20260923 19:38:40.005666 26270 heartbeater.cc:503] Master 127.12.159.254:34473 was elected leader, sending a full tablet report...
I20260923 19:38:40.006206 26296 ts_tablet_manager.cc:1428] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260923 19:38:40.014967 26298 raft_consensus.cc:348] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.014933 26297 raft_consensus.cc:348] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.015370 26297 raft_consensus.cc:374] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:40.015367 26298 raft_consensus.cc:374] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:40.015465 26297 raft_consensus.cc:729] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9d23ea0adc14ba79e974a93cbd78b8d, State: Initialized, Role: FOLLOWER
I20260923 19:38:40.015473 26298 raft_consensus.cc:729] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c109cb540e5b4afbad9a6ed46ee2de7d, State: Initialized, Role: FOLLOWER
I20260923 19:38:40.016088 26297 consensus_queue.cc:260] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.016168 26298 consensus_queue.cc:260] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.017364 25989 heartbeater.cc:503] Master 127.12.159.254:34473 was elected leader, sending a full tablet report...
I20260923 19:38:40.017967 26297 ts_tablet_manager.cc:1428] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260923 19:38:40.018874 26134 heartbeater.cc:503] Master 127.12.159.254:34473 was elected leader, sending a full tablet report...
I20260923 19:38:40.019512 26298 ts_tablet_manager.cc:1428] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
W20260923 19:38:40.034075 25990 tablet.cc:2369] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:38:40.062366 26136 tablet.cc:2369] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:38:40.113318 26271 tablet.cc:2369] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:38:40.348235 26303 raft_consensus.cc:482] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:38:40.348590 26303 raft_consensus.cc:504] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.350551 26303 leader_election.cc:288] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c109cb540e5b4afbad9a6ed46ee2de7d (127.12.159.194:33749), 9af43ce232194861bd74e78680160179 (127.12.159.195:39723)
I20260923 19:38:40.357775 26295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.351242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:52441 (local address 127.12.159.195:39723)
0923 19:38:40.351431 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:40.351438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:40.352287 (+ 849us) server_negotiation.cc:407] Connection header received
0923 19:38:40.352548 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:40.352552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:40.352609 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:40.352699 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:40.353306 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.354085 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.355969 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.356806 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.356992 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.357082 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:40.357371 (+ 289us) server_negotiation.cc:299] Negotiation successful
0923 19:38:40.357500 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 19:38:40.357888 26293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.350875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:41079 (local address 127.12.159.194:33749)
0923 19:38:40.351088 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:40.351096 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:40.352190 (+ 1094us) server_negotiation.cc:407] Connection header received
0923 19:38:40.352435 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:40.352439 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:40.352543 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:40.352648 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:40.353258 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.354049 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.355979 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.356909 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.357088 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.357168 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:40.357470 (+ 302us) server_negotiation.cc:299] Negotiation successful
0923 19:38:40.357597 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:38:40.358012 26306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.350915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:39723 (local address 127.12.159.193:52441)
0923 19:38:40.352170 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:40.352184 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:40.352368 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:40.352725 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:40.352729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:40.352756 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:40.353154 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:40.353162 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.354203 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.354211 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:40.355818 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:40.355830 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.357025 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.357031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:40.357209 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.357237 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 19:38:40.357356 (+ 119us) client_negotiation.cc:240] Negotiation successful
0923 19:38:40.357545 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1116,"mutex_wait_us":21,"thread_start_us":950,"threads_started":1}
I20260923 19:38:40.358390 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.350753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:33749 (local address 127.12.159.193:41079)
0923 19:38:40.352066 (+ 1313us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:40.352081 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:40.352291 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:40.352662 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:40.352667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:40.352691 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:40.353093 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:40.353105 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.354178 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.354184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:40.355832 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:40.355844 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.357127 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.357133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:40.357318 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.357340 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:38:40.357443 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 19:38:40.357572 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1180,"mutex_wait_us":91,"thread_start_us":875,"threads_started":1}
I20260923 19:38:40.359064 26223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02f5ce25b02f430a946aaa46ec22c25c" candidate_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af43ce232194861bd74e78680160179" is_pre_election: true
I20260923 19:38:40.359297 26089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02f5ce25b02f430a946aaa46ec22c25c" candidate_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" is_pre_election: true
I20260923 19:38:40.359544 26223 raft_consensus.cc:2454] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9d23ea0adc14ba79e974a93cbd78b8d in term 0.
I20260923 19:38:40.359836 26089 raft_consensus.cc:2454] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9d23ea0adc14ba79e974a93cbd78b8d in term 0.
I20260923 19:38:40.360234 25880 leader_election.cc:302] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9af43ce232194861bd74e78680160179, e9d23ea0adc14ba79e974a93cbd78b8d; no voters:
I20260923 19:38:40.360705 26303 raft_consensus.cc:2781] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:38:40.360881 26303 raft_consensus.cc:482] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:38:40.360996 26303 raft_consensus.cc:3037] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:40.363489 26303 raft_consensus.cc:504] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.364274 26303 leader_election.cc:288] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [CANDIDATE]: Term 1 election: Requested vote from peers c109cb540e5b4afbad9a6ed46ee2de7d (127.12.159.194:33749), 9af43ce232194861bd74e78680160179 (127.12.159.195:39723)
I20260923 19:38:40.364732 26223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02f5ce25b02f430a946aaa46ec22c25c" candidate_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9af43ce232194861bd74e78680160179"
I20260923 19:38:40.364820 26089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02f5ce25b02f430a946aaa46ec22c25c" candidate_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d"
I20260923 19:38:40.364959 26223 raft_consensus.cc:3037] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:40.365013 26089 raft_consensus.cc:3037] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:40.368206 26089 raft_consensus.cc:2454] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9d23ea0adc14ba79e974a93cbd78b8d in term 1.
I20260923 19:38:40.368206 26223 raft_consensus.cc:2454] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9d23ea0adc14ba79e974a93cbd78b8d in term 1.
I20260923 19:38:40.368681 25877 leader_election.cc:302] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c109cb540e5b4afbad9a6ed46ee2de7d, e9d23ea0adc14ba79e974a93cbd78b8d; no voters:
I20260923 19:38:40.369045 26303 raft_consensus.cc:2781] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:38:40.369551 26303 raft_consensus.cc:686] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 1 LEADER]: Becoming Leader. State: Replica: e9d23ea0adc14ba79e974a93cbd78b8d, State: Running, Role: LEADER
I20260923 19:38:40.370198 26303 consensus_queue.cc:237] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } }
I20260923 19:38:40.374899 25791 catalog_manager.cc:5495] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to e9d23ea0adc14ba79e974a93cbd78b8d (127.12.159.193). New cstate: current_term: 1 leader_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9d23ea0adc14ba79e974a93cbd78b8d" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 } health_report { overall_health: UNKNOWN } } }
I20260923 19:38:40.426218 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.420385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54754 (local address 127.12.159.193:41537)
0923 19:38:40.420570 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:40.420575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:40.420935 (+ 360us) server_negotiation.cc:407] Connection header received
0923 19:38:40.421112 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:40.421116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:40.421194 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:40.421321 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:38:40.421713 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.422539 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.424009 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.424405 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.424497 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.424980 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:38:40.425500 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:38:40.425617 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:40.425762 (+ 145us) server_negotiation.cc:299] Negotiation successful
0923 19:38:40.425913 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:38:40.434820 26089 raft_consensus.cc:1261] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 1 FOLLOWER]: Refusing update from remote peer e9d23ea0adc14ba79e974a93cbd78b8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:40.434820 26223 raft_consensus.cc:1261] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 1 FOLLOWER]: Refusing update from remote peer e9d23ea0adc14ba79e974a93cbd78b8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:40.436045 26307 consensus_queue.cc:1035] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c109cb540e5b4afbad9a6ed46ee2de7d" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:40.436432 26303 consensus_queue.cc:1035] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9af43ce232194861bd74e78680160179" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:40.447685 26311 mvcc.cc:205] Tried to move back new op lower bound from 7332627744490070016 to 7332627744240087040. Current Snapshot: MvccSnapshot[applied={T|T < 7332627744490070016}]
I20260923 19:38:40.449262 26312 mvcc.cc:205] Tried to move back new op lower bound from 7332627744490070016 to 7332627744240087040. Current Snapshot: MvccSnapshot[applied={T|T < 7332627744490070016}]
I20260923 19:38:40.462867 25790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:38:40.463151 25790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:38:40.466940 25790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 260303bafff845eea130f2493df29063: Sending DeleteTablet for 3 replicas of tablet 02f5ce25b02f430a946aaa46ec22c25c
I20260923 19:38:40.468245 26069 tablet_service.cc:1514] Processing DeleteTablet for tablet 02f5ce25b02f430a946aaa46ec22c25c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:40 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:44016
I20260923 19:38:40.468436 26203 tablet_service.cc:1514] Processing DeleteTablet for tablet 02f5ce25b02f430a946aaa46ec22c25c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:40 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:58876
I20260923 19:38:40.468796 25924 tablet_service.cc:1514] Processing DeleteTablet for tablet 02f5ce25b02f430a946aaa46ec22c25c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:40 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:54752
I20260923 19:38:40.471505 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 25828
I20260923 19:38:40.486248 26322 tablet_replica.cc:330] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: stopping tablet replica
I20260923 19:38:40.486315 26321 tablet_replica.cc:330] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: stopping tablet replica
I20260923 19:38:40.486773 26322 raft_consensus.cc:2229] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:38:40.487269 26321 raft_consensus.cc:2229] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:38:40.487370 26322 raft_consensus.cc:2258] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:40.487970 26321 raft_consensus.cc:2258] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:40.490134 26323 tablet_replica.cc:330] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: stopping tablet replica
I20260923 19:38:40.490332 26321 ts_tablet_manager.cc:1905] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:40.490551 26323 raft_consensus.cc:2229] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:38:40.491220 26323 raft_consensus.cc:2258] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:40.491885 26322 ts_tablet_manager.cc:1905] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:40.493074 26323 ts_tablet_manager.cc:1905] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:40.497501 26321 ts_tablet_manager.cc:1918] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:40.497674 26321 log.cc:1196] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/02f5ce25b02f430a946aaa46ec22c25c
I20260923 19:38:40.498430 26321 ts_tablet_manager.cc:1939] T 02f5ce25b02f430a946aaa46ec22c25c P c109cb540e5b4afbad9a6ed46ee2de7d: Deleting consensus metadata
I20260923 19:38:40.498764 26322 ts_tablet_manager.cc:1918] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:40.498914 26322 log.cc:1196] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/02f5ce25b02f430a946aaa46ec22c25c
I20260923 19:38:40.499477 26322 ts_tablet_manager.cc:1939] T 02f5ce25b02f430a946aaa46ec22c25c P 9af43ce232194861bd74e78680160179: Deleting consensus metadata
I20260923 19:38:40.500514 25775 catalog_manager.cc:4841] TS c109cb540e5b4afbad9a6ed46ee2de7d (127.12.159.194:33749): tablet 02f5ce25b02f430a946aaa46ec22c25c (table test-table [id=2d84723097464451b31cc71bf06bcd6e]) successfully deleted
I20260923 19:38:40.500727 26323 ts_tablet_manager.cc:1918] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:40.500941 26323 log.cc:1196] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/02f5ce25b02f430a946aaa46ec22c25c
I20260923 19:38:40.501108 25778 catalog_manager.cc:4841] TS 9af43ce232194861bd74e78680160179 (127.12.159.195:39723): tablet 02f5ce25b02f430a946aaa46ec22c25c (table test-table [id=2d84723097464451b31cc71bf06bcd6e]) successfully deleted
I20260923 19:38:40.501487 26323 ts_tablet_manager.cc:1939] T 02f5ce25b02f430a946aaa46ec22c25c P e9d23ea0adc14ba79e974a93cbd78b8d: Deleting consensus metadata
I20260923 19:38:40.502884 25778 catalog_manager.cc:4841] TS e9d23ea0adc14ba79e974a93cbd78b8d (127.12.159.193:41537): tablet 02f5ce25b02f430a946aaa46ec22c25c (table test-table [id=2d84723097464451b31cc71bf06bcd6e]) successfully deleted
I20260923 19:38:40.514784 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.472672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54766 (local address 127.12.159.193:41537)
0923 19:38:40.472852 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:40.472858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:40.481563 (+ 8705us) server_negotiation.cc:407] Connection header received
0923 19:38:40.481964 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:40.481974 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:40.482083 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:40.482175 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:40.484796 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.486288 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.489924 (+ 3636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.490591 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.490729 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.508388 (+ 17659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:40.508401 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:40.508415 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:40.508461 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:40.511590 (+ 3129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:40.512422 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:40.512429 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:40.512431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:40.512579 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:40.512980 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:40.512989 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:40.512991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:40.513345 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:40.513658 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:40.514031 (+ 373us) server_negotiation.cc:299] Negotiation successful
0923 19:38:40.514283 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:38:40.515527 25984 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:40.619521 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 25828
I20260923 19:38:40.637645 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 25993
I20260923 19:38:40.652004 26293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.638445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.12.159.194:33749)
0923 19:38:40.638661 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:40.638666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:40.638780 (+ 114us) server_negotiation.cc:407] Connection header received
0923 19:38:40.638958 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:40.638962 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:40.639032 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:40.639117 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:40.640473 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.641161 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.642525 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.642914 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.643008 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.645533 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:40.645546 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:40.645562 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:40.645601 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:40.648961 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:40.649745 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:40.649752 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:40.649755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:40.650032 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:40.650452 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:40.650456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:40.650458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:40.650803 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:40.651074 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:40.651444 (+ 370us) server_negotiation.cc:299] Negotiation successful
0923 19:38:40.651623 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260923 19:38:40.652714 26129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:40.742044 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 25993
I20260923 19:38:40.759096 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26135
I20260923 19:38:40.772615 26295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:40.759866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58886 (local address 127.12.159.195:39723)
0923 19:38:40.760092 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:40.760097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:40.760117 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:38:40.760288 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:40.760292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:40.760383 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:40.760463 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:40.761988 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.762812 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.764102 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:40.764509 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:40.764612 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:40.767283 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:40.767297 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:40.767313 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:40.767350 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:40.770218 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:40.770826 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:40.770833 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:40.770835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:40.770972 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:40.771265 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:40.771268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:40.771270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:40.771598 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:40.771805 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:40.772084 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 19:38:40.772233 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:38:40.773254 26264 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:40.862946 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26135
I20260923 19:38:40.879875 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 25758
I20260923 19:38:40.881184 25821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:40.995752 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 25758
I20260923 19:38:41.019906 12927 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 19:38:41.355187 12927 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 19:38:41.355407 12927 mini_ranger.cc:66] Stopping Ranger...
I20260923 19:38:41.700860 12927 mini_ranger.cc:68] Stopped Ranger
2026-09-23 19:38:41.701 UTC [24809] LOG: received smart shutdown request
2026-09-23 19:38:41.704 UTC [24809] LOG: background worker "logical replication launcher" (PID 24818) exited with exit code 1
2026-09-23 19:38:41.705 UTC [24813] LOG: shutting down
2026-09-23 19:38:41.896 UTC [24809] LOG: database system is shut down
2026-09-23T19:38:41Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53650 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:38:42 dist-test-slave-lzv7 krb5kdc[26337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:38:42 dist-test-slave-lzv7 krb5kdc[26337](info): set up 2 sockets
Sep 23 19:38:42 dist-test-slave-lzv7 krb5kdc[26337](info): commencing operation
krb5kdc: starting...
W20260923 19:38:43.126312 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:38:43 dist-test-slave-lzv7 krb5kdc[26337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:38:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:38:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:38:43.358115 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:36577
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:46207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:36577,127.12.159.253:44255,127.12.159.252:44085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:43.685773 26350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:43.686200 26350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:43.686364 26350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:43.693640 26350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:43.693823 26350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:43.693933 26350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:43.694037 26350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:43.694119 26350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:43.704852 26350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:46207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:36577,127.12.159.253:44255,127.12.159.252:44085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:36577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:43.706357 26350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:43.707674 26350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:43.719566 26355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:43.719645 26356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:43.719666 26358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:43.721064 26350 server_base.cc:1034] running on GCE node
I20260923 19:38:43.721944 26350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:43.723438 26350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:43.724658 26350 hybrid_clock.cc:648] HybridClock initialized: now 1790192323724605 us; error 42 us; skew 500 ppm
I20260923 19:38:43.725051 26350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:43 dist-test-slave-lzv7 krb5kdc[26337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:43.741119 26350 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:38:43.743008 26350 webserver.cc:460] Webserver started at http://127.12.159.254:38103/ using document root <none> and password file <none>
I20260923 19:38:43.743809 26350 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:43.743970 26350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:43.744307 26350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:43.747527 26350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "c10139d3732e431d879c20ecc9b562b7"
format_stamp: "Formatted at 2026-09-23 19:38:43 on dist-test-slave-lzv7"
server_key: "2bb82e80469c31768634f8d0ccc0efec"
server_key_iv: "3d5273fd019c6bfce0d5d14c5e3112e9"
server_key_version: "encryptionkey@0"
I20260923 19:38:43.748430 26350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "c10139d3732e431d879c20ecc9b562b7"
format_stamp: "Formatted at 2026-09-23 19:38:43 on dist-test-slave-lzv7"
server_key: "2bb82e80469c31768634f8d0ccc0efec"
server_key_iv: "3d5273fd019c6bfce0d5d14c5e3112e9"
server_key_version: "encryptionkey@0"
I20260923 19:38:43.754076 26350 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:38:43.757687 26365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:43.759451 26350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:38:43.759727 26350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "c10139d3732e431d879c20ecc9b562b7"
format_stamp: "Formatted at 2026-09-23 19:38:43 on dist-test-slave-lzv7"
server_key: "2bb82e80469c31768634f8d0ccc0efec"
server_key_iv: "3d5273fd019c6bfce0d5d14c5e3112e9"
server_key_version: "encryptionkey@0"
I20260923 19:38:43.759969 26350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:43.778229 26350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:43.783483 26350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:43.783854 26350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:43.804857 26350 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:36577
I20260923 19:38:43.804873 26416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:36577 every 8 connection(s)
I20260923 19:38:43.806527 26350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:38:43.810658 26417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:43.810894 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26350
I20260923 19:38:43.811153 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:38:43.811872 12927 external_mini_cluster.cc:1428] Setting key 019204aa6cb61b5cac1ed2fae6eac5c6
I20260923 19:38:43.817896 26417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.159.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.253@KRBTEST.COM" created.
Sep 23 19:38:43 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:43.845119 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.823301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55572 (local address 127.12.159.254:36577)
0923 19:38:43.824047 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:43.824060 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:43.824114 (+ 54us) server_negotiation.cc:407] Connection header received
0923 19:38:43.825648 (+ 1534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:43.825654 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:43.825999 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:43.826216 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:43.827554 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:43.828796 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:43.830505 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:43.831128 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:43.831349 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:43.836988 (+ 5639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:43.836997 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:43.837011 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:43.837042 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:43.840209 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:43.841004 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:43.841018 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:43.841021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:43.841182 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:43.841608 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:43.841615 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:43.841623 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:43.842251 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:43.842496 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:43.843073 (+ 577us) server_negotiation.cc:299] Negotiation successful
0923 19:38:43.843525 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":545,"thread_start_us":340,"threads_started":1}
I20260923 19:38:43.845140 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.821590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36577 (local address 127.0.0.1:55572)
0923 19:38:43.822611 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:43.822657 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:43.825153 (+ 2496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:43.826229 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:43.826244 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:43.827011 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:43.827355 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:43.827373 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:43.828961 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:43.828971 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:43.830350 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:43.830365 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:43.831388 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:43.831395 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:43.831608 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:43.832344 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:43.832370 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:43.836731 (+ 4361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:43.840377 (+ 3646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:43.840390 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:43.840404 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:43.840854 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:43.841300 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:43.841308 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:43.841312 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:43.841485 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:43.842397 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:43.842419 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:43.842658 (+ 239us) client_negotiation.cc:769] Sending connection context
0923 19:38:43.842932 (+ 274us) client_negotiation.cc:240] Negotiation successful
0923 19:38:43.843646 (+ 714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":185,"thread_start_us":417,"threads_started":1}
I20260923 19:38:43.849181 26417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:38:43.850396 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.849985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36274)
0923 19:38:43.850158 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:43.850273 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:38:43.850684 26366 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
I20260923 19:38:43.852481 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.851978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36276)
0923 19:38:43.852210 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:43.852310 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260923 19:38:43.852809 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:44255: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab.
Entry for principal kudu/127.12.159.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab.
I20260923 19:38:43.866045 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:44255
--webserver_interface=127.12.159.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab
--principal=kudu/127.12.159.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:46207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:36577,127.12.159.253:44255,127.12.159.252:44085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:38:43.902204 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } attempt: 1
I20260923 19:38:43.903523 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.903016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36284)
0923 19:38:43.903236 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:43.903377 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260923 19:38:43.904639 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.904262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36294)
0923 19:38:43.904423 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:43.904501 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260923 19:38:43.904975 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:44255: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
I20260923 19:38:43.973282 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } attempt: 2
I20260923 19:38:43.974681 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.974121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36296)
0923 19:38:43.974403 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:43.974509 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260923 19:38:43.975850 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:43.975444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36300)
0923 19:38:43.975602 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:43.975703 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 19:38:43.976081 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:44255: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
I20260923 19:38:44.067363 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } attempt: 3
I20260923 19:38:44.068538 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.068086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36306)
0923 19:38:44.068307 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.068405 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260923 19:38:44.069579 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.069231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36318)
0923 19:38:44.069375 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.069450 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:38:44.069885 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:44255: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
W20260923 19:38:44.191866 26424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:44.192167 26424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:44.192327 26424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:44.199728 26424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:44.199855 26424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:44.199945 26424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:44.200057 26424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:44.200124 26424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:44.210160 26424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:46207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:36577,127.12.159.253:44255,127.12.159.252:44085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab
--principal=kudu/127.12.159.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:44255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.159.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:44.211544 26424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:44.212913 26424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 19:38:44.213152 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } attempt: 4
I20260923 19:38:44.214359 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.213789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36332)
0923 19:38:44.214130 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.214230 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186}
I20260923 19:38:44.215374 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.215024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36342)
0923 19:38:44.215166 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.215263 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260923 19:38:44.215562 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:44255: Network error: Client connection negotiation failed: client connection to 127.12.159.253:44255: connect: Connection refused (error 111)
W20260923 19:38:44.225231 26429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:44.225172 26432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:44.225256 26430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:44.226460 26424 server_base.cc:1034] running on GCE node
I20260923 19:38:44.227224 26424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:44.228574 26424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:44.229769 26424 hybrid_clock.cc:648] HybridClock initialized: now 1790192324229713 us; error 50 us; skew 500 ppm
I20260923 19:38:44.230137 26424 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:44.233323 26424 init.cc:377] Logged in from keytab as kudu/127.12.159.253@KRBTEST.COM (short username kudu)
I20260923 19:38:44.234977 26424 webserver.cc:460] Webserver started at http://127.12.159.253:33989/ using document root <none> and password file <none>
I20260923 19:38:44.235618 26424 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:44.235713 26424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:44.235966 26424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:44.238925 26424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data/instance:
uuid: "c1e0be704d774a1ea2c9313ce3a8b609"
format_stamp: "Formatted at 2026-09-23 19:38:44 on dist-test-slave-lzv7"
server_key: "bf7b583f1981b9d1ded647084acd5c9b"
server_key_iv: "c04020e011a4651ae37c11dbf0bdee41"
server_key_version: "encryptionkey@0"
I20260923 19:38:44.239701 26424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/wal/instance:
uuid: "c1e0be704d774a1ea2c9313ce3a8b609"
format_stamp: "Formatted at 2026-09-23 19:38:44 on dist-test-slave-lzv7"
server_key: "bf7b583f1981b9d1ded647084acd5c9b"
server_key_iv: "c04020e011a4651ae37c11dbf0bdee41"
server_key_version: "encryptionkey@0"
I20260923 19:38:44.244740 26424 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:38:44.248061 26439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:44.249454 26424 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:38:44.249595 26424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/wal
uuid: "c1e0be704d774a1ea2c9313ce3a8b609"
format_stamp: "Formatted at 2026-09-23 19:38:44 on dist-test-slave-lzv7"
server_key: "bf7b583f1981b9d1ded647084acd5c9b"
server_key_iv: "c04020e011a4651ae37c11dbf0bdee41"
server_key_version: "encryptionkey@0"
I20260923 19:38:44.249759 26424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:44.268180 26424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:44.273298 26424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:44.273605 26424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:44.292505 26424 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.253:44255
I20260923 19:38:44.292591 26490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.253:44255 every 8 connection(s)
I20260923 19:38:44.293965 26424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
I20260923 19:38:44.297633 26491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:44.298827 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26424
I20260923 19:38:44.299013 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-1/wal/instance
I20260923 19:38:44.299613 12927 external_mini_cluster.cc:1428] Setting key 9551721533ab93fbf4fc6d2260e776b1
I20260923 19:38:44.308076 26491 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.159.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.252@KRBTEST.COM" created.
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:44.336153 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.311228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55586 (local address 127.12.159.254:36577)
0923 19:38:44.311556 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.311563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.312856 (+ 1293us) server_negotiation.cc:407] Connection header received
0923 19:38:44.315877 (+ 3021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.315882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.315956 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.316050 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.318357 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.319039 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.321761 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.322255 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.322361 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.328016 (+ 5655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.328027 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.328034 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.328087 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.331911 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.332695 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.332703 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.332710 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.332863 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.333268 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.333275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.333281 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.333695 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.333879 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.335564 (+ 1685us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.335804 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260923 19:38:44.336823 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.311786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36577 (local address 127.0.0.1:55586)
0923 19:38:44.312649 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.312699 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:44.315547 (+ 2848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:44.316336 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:44.316351 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:44.317232 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:44.318144 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.318174 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.319215 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.319223 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.321534 (+ 2311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.321550 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.322520 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.322528 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.322853 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.323625 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:44.323653 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:44.327734 (+ 4081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:44.332075 (+ 4341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.332083 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.332098 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.332552 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.332968 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.332972 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.332974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.333139 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.333953 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:44.333968 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:44.334487 (+ 519us) client_negotiation.cc:769] Sending connection context
0923 19:38:44.334796 (+ 309us) client_negotiation.cc:240] Negotiation successful
0923 19:38:44.335364 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":334,"threads_started":1}
I20260923 19:38:44.338816 26491 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:38:44.355578 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.339672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36344)
0923 19:38:44.339901 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.339928 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:44.340093 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:44.340899 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:44.340903 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:44.341275 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:44.341411 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.341418 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.343490 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.343494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.344433 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.344445 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.345711 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.345715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.346003 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.346639 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:44.346655 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:44.348681 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:44.352548 (+ 3867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.352552 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.352555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.353088 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.353495 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.353499 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.353502 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.353727 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.354541 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:44.354547 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:44.354686 (+ 139us) client_negotiation.cc:769] Sending connection context
0923 19:38:44.354889 (+ 203us) client_negotiation.cc:240] Negotiation successful
0923 19:38:44.355169 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":25}
I20260923 19:38:44.355702 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.339708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36344 (local address 127.12.159.253:44255)
0923 19:38:44.340366 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.340377 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.340408 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:38:44.340468 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.340478 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.340715 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.340884 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.341576 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.343348 (+ 1772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.344574 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.345572 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.345713 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.348932 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.348950 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.348971 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.349007 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.352401 (+ 3394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.353227 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.353234 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.353237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.353360 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.353929 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.353934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.353937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.354365 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.354638 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.355077 (+ 439us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.355301 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":439,"thread_start_us":286,"threads_started":1}
I20260923 19:38:44.358415 26491 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:38:44.359500 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.359079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42242)
0923 19:38:44.359240 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.359351 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260923 19:38:44.359767 26440 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab.
Entry for principal kudu/127.12.159.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab.
I20260923 19:38:44.362092 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.361086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42258)
0923 19:38:44.361878 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.361974 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":615}
W20260923 19:38:44.362322 26491 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
I20260923 19:38:44.362799 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:44085
--webserver_interface=127.12.159.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab
--principal=kudu/127.12.159.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:46207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:36577,127.12.159.253:44255,127.12.159.252:44085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:38:44.411718 26491 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 1
I20260923 19:38:44.412871 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.412398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42268)
0923 19:38:44.412604 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.412720 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260923 19:38:44.414108 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.413634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42270)
0923 19:38:44.413920 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.413998 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260923 19:38:44.414325 26491 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
I20260923 19:38:44.482553 26491 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 2
I20260923 19:38:44.483760 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.483288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42280)
0923 19:38:44.483495 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.483591 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 19:38:44.484930 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.484521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42288)
0923 19:38:44.484738 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.484816 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:38:44.485146 26491 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
I20260923 19:38:44.514887 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } attempt: 5
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:38:44.531618 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.515650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36358)
0923 19:38:44.515865 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.515889 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:44.516020 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:44.516423 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:44.516430 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:44.516826 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:44.517002 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.517010 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.518072 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.518079 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.518967 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.518977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.519694 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.519700 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.519890 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.520660 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:44.520684 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:44.524024 (+ 3340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:44.528413 (+ 4389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.528418 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.528423 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.529166 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.529646 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.529651 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.529655 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.529847 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.530510 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:44.530516 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:44.530722 (+ 206us) client_negotiation.cc:769] Sending connection context
0923 19:38:44.531017 (+ 295us) client_negotiation.cc:240] Negotiation successful
0923 19:38:44.531342 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260923 19:38:44.531636 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.515810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36358 (local address 127.12.159.253:44255)
0923 19:38:44.515988 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.515994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.516015 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:38:44.516207 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.516211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.516272 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.516384 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.517167 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.517946 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.519104 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.519537 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.519667 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.524280 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.524287 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.524292 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.524355 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.528244 (+ 3889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.529350 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.529355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.529359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.529509 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.529981 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.529986 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.529989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.530364 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.530512 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.531041 (+ 529us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.531272 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 19:38:44.532663 26417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:38:44.533650 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.533292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42304)
0923 19:38:44.533458 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.533529 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260923 19:38:44.534631 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.534346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42314)
0923 19:38:44.534466 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.534538 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 19:38:44.534891 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
I20260923 19:38:44.576390 26491 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 3
I20260923 19:38:44.577520 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.577062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42324)
0923 19:38:44.577259 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.577363 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260923 19:38:44.578640 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.578217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42340)
0923 19:38:44.578461 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.578531 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
W20260923 19:38:44.578845 26491 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
I20260923 19:38:44.586203 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 1
I20260923 19:38:44.587332 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.586889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42356)
0923 19:38:44.587070 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.587170 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260923 19:38:44.588282 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.587969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42362)
0923 19:38:44.588114 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.588187 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:38:44.588488 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
I20260923 19:38:44.656720 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 2
I20260923 19:38:44.657924 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.657374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42370)
0923 19:38:44.657615 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.657705 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260923 19:38:44.658896 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.658560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42380)
0923 19:38:44.658704 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.658793 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260923 19:38:44.659078 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
W20260923 19:38:44.697700 26498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:44.698117 26498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:44.698287 26498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:44.706063 26498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:44.706214 26498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:44.706306 26498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:44.706393 26498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:44.706481 26498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:44.716912 26498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:46207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:36577,127.12.159.253:44255,127.12.159.252:44085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab
--principal=kudu/127.12.159.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:44085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.159.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:44.718418 26498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:44.719765 26498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 19:38:44.722052 26491 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 4
I20260923 19:38:44.723204 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.722714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42382)
0923 19:38:44.722952 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.723033 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260923 19:38:44.724344 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.723928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42386)
0923 19:38:44.724150 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.724233 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260923 19:38:44.724653 26491 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
W20260923 19:38:44.732120 26503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:44.732151 26504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:44.732107 26506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:44.733145 26498 server_base.cc:1034] running on GCE node
I20260923 19:38:44.734100 26498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:44.735563 26498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:44.736797 26498 hybrid_clock.cc:648] HybridClock initialized: now 1790192324736757 us; error 34 us; skew 500 ppm
I20260923 19:38:44.737164 26498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:44.740571 26498 init.cc:377] Logged in from keytab as kudu/127.12.159.252@KRBTEST.COM (short username kudu)
I20260923 19:38:44.742345 26498 webserver.cc:460] Webserver started at http://127.12.159.252:38717/ using document root <none> and password file <none>
I20260923 19:38:44.743089 26498 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:44.743223 26498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:44.743543 26498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:44.746876 26498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data/instance:
uuid: "f1e57abecebf45a28b0041f4b73b5a17"
format_stamp: "Formatted at 2026-09-23 19:38:44 on dist-test-slave-lzv7"
server_key: "9f94615c59d512a9bdffe19b06345b98"
server_key_iv: "62745331a171bb674b7d30ddd65b8bc6"
server_key_version: "encryptionkey@0"
I20260923 19:38:44.747735 26498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/wal/instance:
uuid: "f1e57abecebf45a28b0041f4b73b5a17"
format_stamp: "Formatted at 2026-09-23 19:38:44 on dist-test-slave-lzv7"
server_key: "9f94615c59d512a9bdffe19b06345b98"
server_key_iv: "62745331a171bb674b7d30ddd65b8bc6"
server_key_version: "encryptionkey@0"
I20260923 19:38:44.753003 26498 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:38:44.756815 26513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:44.758275 26498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:44.758462 26498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/wal
uuid: "f1e57abecebf45a28b0041f4b73b5a17"
format_stamp: "Formatted at 2026-09-23 19:38:44 on dist-test-slave-lzv7"
server_key: "9f94615c59d512a9bdffe19b06345b98"
server_key_iv: "62745331a171bb674b7d30ddd65b8bc6"
server_key_version: "encryptionkey@0"
I20260923 19:38:44.758666 26498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:44.765262 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 3
I20260923 19:38:44.766319 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.765900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42398)
0923 19:38:44.766070 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.766153 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 19:38:44.767279 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.766950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42406)
0923 19:38:44.767107 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.767183 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260923 19:38:44.767495 26417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:44085: Network error: Client connection negotiation failed: client connection to 127.12.159.252:44085: connect: Connection refused (error 111)
I20260923 19:38:44.787627 26498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:44.791961 26498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:44.792255 26498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:44.811933 26498 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.252:44085
I20260923 19:38:44.811955 26564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.252:44085 every 8 connection(s)
I20260923 19:38:44.813333 26498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
I20260923 19:38:44.816249 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26498
I20260923 19:38:44.816431 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192117815085-12927-0/minicluster-data/master-2/wal/instance
I20260923 19:38:44.816897 12927 external_mini_cluster.cc:1428] Setting key b5be4b7673ff388397d5cbb12c1e71b2
I20260923 19:38:44.817085 26565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:44.826851 26565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:44.843034 26568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.818960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42414 (local address 127.12.159.252:44085)
0923 19:38:44.819805 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.819817 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.819876 (+ 59us) server_negotiation.cc:407] Connection header received
0923 19:38:44.821867 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.821900 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.822341 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.822720 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.824530 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.825952 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.827815 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.828611 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.828763 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.834065 (+ 5302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.834075 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.834095 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.834167 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.838270 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.839060 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.839069 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.839083 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.839251 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.839696 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.839699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.839701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.840249 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.840542 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.841093 (+ 551us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.841539 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":389,"threads_started":1}
I20260923 19:38:44.846166 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.829832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55592 (local address 127.12.159.254:36577)
0923 19:38:44.830095 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.830102 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.831054 (+ 952us) server_negotiation.cc:407] Connection header received
0923 19:38:44.831269 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.831273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.831336 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.831413 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.832755 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.833885 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.835927 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.836364 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.836461 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.840161 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.840171 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.840174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.840206 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.843401 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.844101 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.844108 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.844111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.844250 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.844612 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.844619 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.844622 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.844877 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.845043 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.845531 (+ 488us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.845729 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260923 19:38:44.846176 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.830031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:36577 (local address 127.0.0.1:55592)
0923 19:38:44.830903 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.830952 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:44.831127 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:44.831512 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:44.831521 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:44.832319 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:44.832574 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.832582 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.834049 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.834054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.835758 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.835777 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.836559 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.836566 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.836751 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.837396 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:44.837422 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:44.839968 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:44.843539 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.843551 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.843562 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.843982 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.844370 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.844375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.844378 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.844510 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.845022 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:44.845030 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:44.845224 (+ 194us) client_negotiation.cc:769] Sending connection context
0923 19:38:44.845414 (+ 190us) client_negotiation.cc:240] Negotiation successful
0923 19:38:44.845720 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":427,"threads_started":1}
I20260923 19:38:44.847676 26565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:44.861588 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.848396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:44255 (local address 127.0.0.1:36368)
0923 19:38:44.848579 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.848597 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:44.848692 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:44.849056 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:44.849059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:44.849370 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:44.849500 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.849506 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.850574 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.850579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.851720 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.851731 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.852533 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.852539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.852766 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.853279 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:44.853296 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:44.855437 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:44.858880 (+ 3443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.858887 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.858890 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.859409 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.859831 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.859838 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.859844 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.860020 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.860667 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:44.860671 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:44.860849 (+ 178us) client_negotiation.cc:769] Sending connection context
0923 19:38:44.861008 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 19:38:44.861265 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260923 19:38:44.861934 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.848520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36368 (local address 127.12.159.253:44255)
0923 19:38:44.848670 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.848674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.848690 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:38:44.848824 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.848830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.848917 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.849025 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.849638 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.850436 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.851858 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.852382 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.852522 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.855636 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.855645 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.855653 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.855701 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.858741 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.859529 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.859533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.859535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.859664 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.860148 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.860154 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.860157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.860531 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.860695 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.861126 (+ 431us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.861357 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 19:38:44.863049 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.846210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55604 (local address 127.12.159.254:36577)
0923 19:38:44.846903 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.846908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.846932 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:38:44.847042 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.847047 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.847114 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.847235 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.848807 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.849832 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.851375 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.851863 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.851986 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.856632 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.856637 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.856641 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.856673 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.859932 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.860860 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.860866 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.860869 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.861012 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.861458 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.861463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.861467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.861852 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.862117 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.862387 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.862615 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":326,"threads_started":1}
I20260923 19:38:44.863127 26565 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:38:44.877702 26568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.864226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42420 (local address 127.12.159.252:44085)
0923 19:38:44.864381 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.864385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.864398 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:38:44.864433 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.864436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.864510 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.864607 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.865402 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.866209 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.867764 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.868392 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.868503 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.872102 (+ 3599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.872106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.872109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.872136 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.874723 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.875842 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.875849 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.875853 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.875959 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.876288 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.876295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.876298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.876561 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.876704 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.877030 (+ 326us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.877395 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":142,"server-negotiator.queue_time_us":49}
I20260923 19:38:44.877677 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.864014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42420)
0923 19:38:44.864194 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.864214 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:44.864325 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:44.864622 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:44.864626 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:44.865091 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:44.865277 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.865289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.866336 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.866341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.867637 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.867648 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.868546 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.868552 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.868789 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.869351 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:44.869373 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:44.871927 (+ 2554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:44.875406 (+ 3479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.875409 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.875412 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.875725 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.876061 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.876068 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.876071 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.876187 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.876668 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:44.876672 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:44.876800 (+ 128us) client_negotiation.cc:769] Sending connection context
0923 19:38:44.876948 (+ 148us) client_negotiation.cc:240] Negotiation successful
0923 19:38:44.877247 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260923 19:38:44.880322 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.864841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.12.159.253:44255)
0923 19:38:44.864998 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.865005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.865075 (+ 70us) server_negotiation.cc:407] Connection header received
0923 19:38:44.865192 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.865199 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.865281 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.865381 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.867381 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.868337 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.870183 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.870630 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.870761 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.874918 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.874923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.874926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.874955 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.877542 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.878432 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.878436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.878438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.878563 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.878983 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.878988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.878991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.879299 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.879518 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.879849 (+ 331us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.880012 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:38:44.884240 26565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: Bootstrap starting.
I20260923 19:38:44.885426 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:38:44.887630 26565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:44.888800 26565 log.cc:824] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:44.891703 26565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: No bootstrap required, opened a new log
I20260923 19:38:44.905377 26565 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:44.905884 26565 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:44.906018 26565 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e57abecebf45a28b0041f4b73b5a17, State: Initialized, Role: FOLLOWER
I20260923 19:38:44.906821 26565 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:44.908977 26579 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:44.909469 26579 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:38:44.910445 26565 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:44.920258 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.893380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.12.159.254:36577)
0923 19:38:44.893589 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.893597 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.898491 (+ 4894us) server_negotiation.cc:407] Connection header received
0923 19:38:44.898834 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.898840 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.898926 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.899007 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.903201 (+ 4194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.904309 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.906723 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.907417 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.907555 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.913078 (+ 5523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.913085 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.913089 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.913136 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.916754 (+ 3618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.917672 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.917680 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.917688 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.917866 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.918376 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.918380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.918383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.918770 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.919037 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.919636 (+ 599us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.919889 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:38:44.925243 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.893916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36386 (local address 127.12.159.253:44255)
0923 19:38:44.894133 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.894138 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.903039 (+ 8901us) server_negotiation.cc:407] Connection header received
0923 19:38:44.903251 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.903260 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.903368 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.903460 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.906648 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.908090 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.911150 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.911995 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.912146 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.916599 (+ 4453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.916610 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.916617 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.916676 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.921592 (+ 4916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.922748 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.922757 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.922764 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.922939 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.923443 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.923450 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.923454 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.923846 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.924113 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.924580 (+ 467us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.924882 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:38:44.928072 26568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.898706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42432 (local address 127.12.159.252:44085)
0923 19:38:44.899350 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.899358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.909368 (+ 10010us) server_negotiation.cc:407] Connection header received
0923 19:38:44.909536 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.909541 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.909615 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.909707 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.911971 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.913113 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.915351 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.916054 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.916160 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.920137 (+ 3977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.920143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.920148 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.920188 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.923923 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.924819 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.924829 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.924834 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.925039 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.925508 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.925513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.925516 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.926753 (+ 1237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.927026 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.927393 (+ 367us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.927613 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456}
W20260923 19:38:44.935712 26590 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:38:44.935854 26590 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:38:44.932791 26498 master_runner.cc:186] Error getting master registration for 127.12.159.254:36577: OK, instance_id { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" instance_seqno: 1790192323798925 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:38:44.941350 26498 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:38:44.944705 26417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 4
Sep 23 19:38:44 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192323, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
I20260923 19:38:44.960141 26568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.945410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42440 (local address 127.12.159.252:44085)
0923 19:38:44.945580 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:44.945584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:44.945690 (+ 106us) server_negotiation.cc:407] Connection header received
0923 19:38:44.945877 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:44.945882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:44.945968 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:44.946054 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:44.947041 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.947812 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.949640 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.950351 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.950482 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.953784 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:44.953791 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:44.953795 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:44.953860 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:44.957415 (+ 3555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.958224 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.958229 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.958231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.958359 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:44.958786 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:44.958790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:44.958792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:44.959108 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:44.959206 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:44.959682 (+ 476us) server_negotiation.cc:299] Negotiation successful
0923 19:38:44.959878 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:38:44.960268 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:44.945330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42440)
0923 19:38:44.945546 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:44.945567 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:44.945697 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:44.946119 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:44.946124 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:44.946661 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:44.946895 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.946908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.947945 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.947951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.949466 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:44.949482 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:44.950519 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:44.950526 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:44.950670 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:44.951309 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:44.951326 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:44.953610 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:44.957571 (+ 3961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.957576 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.957580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.958108 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.958485 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:44.958490 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:44.958494 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:44.958663 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:44.959240 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:44.959248 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:44.959433 (+ 185us) client_negotiation.cc:769] Sending connection context
0923 19:38:44.959604 (+ 171us) client_negotiation.cc:240] Negotiation successful
0923 19:38:44.959878 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260923 19:38:44.965664 26417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7: Bootstrap starting.
I20260923 19:38:44.968798 26417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:44.969877 26417 log.cc:824] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:44.972512 26417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7: No bootstrap required, opened a new log
I20260923 19:38:44.980096 26417 raft_consensus.cc:348] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:44.980439 26417 raft_consensus.cc:374] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:44.980568 26417 raft_consensus.cc:729] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c10139d3732e431d879c20ecc9b562b7, State: Initialized, Role: FOLLOWER
I20260923 19:38:44.981176 26417 consensus_queue.cc:260] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:44.982239 26593 sys_catalog.cc:455] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:44.982702 26593 sys_catalog.cc:458] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:38:44.983618 26417 sys_catalog.cc:564] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:38:44.993749 26604 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:38:44.993986 26604 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:38:44.993185 26350 master_runner.cc:186] Error getting master registration for 127.12.159.253:44255: OK, instance_id { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" instance_seqno: 1790192324286965 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:38:45.005412 26350 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:38:45.023864 26491 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } attempt: 5
Sep 23 19:38:45 dist-test-slave-lzv7 krb5kdc[26337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192324, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
W20260923 19:38:45.037070 26371 tablet.cc:2369] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:38:45.042912 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:45.024414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:44085 (local address 127.0.0.1:42452)
0923 19:38:45.024622 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:45.024642 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:45.024749 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:45.025649 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:45.025654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:45.026247 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:45.026459 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:45.026470 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:45.028009 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:45.028015 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:45.029467 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:45.029481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:45.030515 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:45.030522 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:45.030740 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:45.031456 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:45.031483 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:45.034378 (+ 2895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:45.038804 (+ 4426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:45.038810 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:45.038814 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:45.039334 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:45.039761 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:45.039766 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:45.039770 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:45.039961 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:45.040623 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:45.040628 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:45.040797 (+ 169us) client_negotiation.cc:769] Sending connection context
0923 19:38:45.040970 (+ 173us) client_negotiation.cc:240] Negotiation successful
0923 19:38:45.042570 (+ 1600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 19:38:45.043576 26568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:45.024951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42452 (local address 127.12.159.252:44085)
0923 19:38:45.025116 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:45.025122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:45.025139 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:38:45.025188 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:45.025193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:45.025299 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:45.025401 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:45.026617 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:45.027847 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:45.029623 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:45.030352 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:45.030491 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:45.034587 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:45.034594 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:45.034599 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:45.034638 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:45.038646 (+ 4008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:45.039469 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:45.039474 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:45.039478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:45.039637 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:45.040087 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:45.040093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:45.040096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:45.040499 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:45.040670 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:45.041081 (+ 411us) server_negotiation.cc:299] Negotiation successful
0923 19:38:45.041346 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260923 19:38:45.044397 26519 tablet.cc:2369] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:38:45.049757 26491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609: Bootstrap starting.
I20260923 19:38:45.054131 26491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:45.055487 26491 log.cc:824] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:45.058877 26491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609: No bootstrap required, opened a new log
I20260923 19:38:45.069125 26593 raft_consensus.cc:482] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:38:45.069491 26593 raft_consensus.cc:504] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:45.071228 26593 leader_election.cc:288] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1e0be704d774a1ea2c9313ce3a8b609 (127.12.159.253:44255), f1e57abecebf45a28b0041f4b73b5a17 (127.12.159.252:44085)
I20260923 19:38:45.072548 26491 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:45.073082 26491 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:45.073242 26491 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1e0be704d774a1ea2c9313ce3a8b609, State: Initialized, Role: FOLLOWER
I20260923 19:38:45.072973 26540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c10139d3732e431d879c20ecc9b562b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e57abecebf45a28b0041f4b73b5a17" is_pre_election: true
I20260923 19:38:45.073619 26540 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c10139d3732e431d879c20ecc9b562b7 in term 0.
I20260923 19:38:45.074150 26491 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:45.074434 26366 leader_election.cc:302] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c10139d3732e431d879c20ecc9b562b7, f1e57abecebf45a28b0041f4b73b5a17; no voters:
I20260923 19:38:45.074918 26593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:38:45.075073 26593 raft_consensus.cc:482] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:38:45.075163 26593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:45.079909 26593 raft_consensus.cc:504] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:45.084184 26540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c10139d3732e431d879c20ecc9b562b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e57abecebf45a28b0041f4b73b5a17"
I20260923 19:38:45.084431 26540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:45.090057 26540 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c10139d3732e431d879c20ecc9b562b7 in term 1.
I20260923 19:38:45.090803 26366 leader_election.cc:302] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c10139d3732e431d879c20ecc9b562b7, f1e57abecebf45a28b0041f4b73b5a17; no voters:
I20260923 19:38:45.095098 26593 leader_election.cc:288] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [CANDIDATE]: Term 1 election: Requested vote from peers c1e0be704d774a1ea2c9313ce3a8b609 (127.12.159.253:44255), f1e57abecebf45a28b0041f4b73b5a17 (127.12.159.252:44085)
I20260923 19:38:45.096261 26593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:38:45.097082 26593 raft_consensus.cc:686] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [term 1 LEADER]: Becoming Leader. State: Replica: c10139d3732e431d879c20ecc9b562b7, State: Running, Role: LEADER
I20260923 19:38:45.100175 26593 consensus_queue.cc:237] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } }
I20260923 19:38:45.122773 26607 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.123350 26607 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:38:45.124372 26465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c10139d3732e431d879c20ecc9b562b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1e0be704d774a1ea2c9313ce3a8b609"
I20260923 19:38:45.124897 26465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:45.126953 26608 sys_catalog.cc:455] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c10139d3732e431d879c20ecc9b562b7. Latest consensus state: current_term: 1 leader_uuid: "c10139d3732e431d879c20ecc9b562b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.127404 26608 sys_catalog.cc:458] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:45.128477 26465 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c10139d3732e431d879c20ecc9b562b7 in term 1.
I20260923 19:38:45.124444 26466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c10139d3732e431d879c20ecc9b562b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" is_pre_election: true
I20260923 19:38:45.129647 26466 raft_consensus.cc:2362] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c10139d3732e431d879c20ecc9b562b7 in term 1. Re-sending same reply.
I20260923 19:38:45.124357 26491 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:45.139073 26610 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:38:45.141305 26610 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:38:45.157603 26540 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [term 1 FOLLOWER]: Refusing update from remote peer c10139d3732e431d879c20ecc9b562b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:45.158633 26608 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:45.166559 26465 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [term 1 FOLLOWER]: Refusing update from remote peer c10139d3732e431d879c20ecc9b562b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:45.167574 26608 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:45.195099 26607 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c10139d3732e431d879c20ecc9b562b7. Latest consensus state: current_term: 1 leader_uuid: "c10139d3732e431d879c20ecc9b562b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.195458 26607 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:38:45.203241 26613 mvcc.cc:205] Tried to move back new op lower bound from 7332627763832582144 to 7332627763652997120. Current Snapshot: MvccSnapshot[applied={T|T < 7332627763832582144}]
I20260923 19:38:45.206431 26607 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c10139d3732e431d879c20ecc9b562b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.206708 26607 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:38:45.208506 26593 sys_catalog.cc:455] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c10139d3732e431d879c20ecc9b562b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.208827 26593 sys_catalog.cc:458] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:45.211921 26610 catalog_manager.cc:1347] Generated new cluster ID: 18fff87e3c1b47c1818292bfdc360fa6
I20260923 19:38:45.212055 26610 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:38:45.217041 26579 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c10139d3732e431d879c20ecc9b562b7. Latest consensus state: current_term: 1 leader_uuid: "c10139d3732e431d879c20ecc9b562b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.217334 26579 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:38:45.219906 26608 sys_catalog.cc:455] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c10139d3732e431d879c20ecc9b562b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.220173 26608 sys_catalog.cc:458] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:45.221210 26627 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:38:45.221885 26617 mvcc.cc:205] Tried to move back new op lower bound from 7332627763832582144 to 7332627763652997120. Current Snapshot: MvccSnapshot[applied={T|T < 7332627763832582144}]
I20260923 19:38:45.248448 26579 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c10139d3732e431d879c20ecc9b562b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c10139d3732e431d879c20ecc9b562b7" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36577 } } peers { permanent_uuid: "c1e0be704d774a1ea2c9313ce3a8b609" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 44255 } } peers { permanent_uuid: "f1e57abecebf45a28b0041f4b73b5a17" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 44085 } } }
I20260923 19:38:45.248687 26579 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:38:45.262076 26610 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:38:45.264215 26610 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:38:45.278599 26610 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c10139d3732e431d879c20ecc9b562b7: Generated new TSK 0
I20260923 19:38:45.279978 26610 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:38:45.937713 26590 catalog_manager.cc:1259] Loaded cluster ID: 18fff87e3c1b47c1818292bfdc360fa6
I20260923 19:38:45.937908 26590 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: loading cluster ID for follower catalog manager: success
I20260923 19:38:45.940304 26590 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: acquiring CA information for follower catalog manager: success
I20260923 19:38:45.942034 26590 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f1e57abecebf45a28b0041f4b73b5a17: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:38:46.226372 26627 catalog_manager.cc:1259] Loaded cluster ID: 18fff87e3c1b47c1818292bfdc360fa6
I20260923 19:38:46.226511 26627 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609: loading cluster ID for follower catalog manager: success
I20260923 19:38:46.229173 26627 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609: acquiring CA information for follower catalog manager: success
I20260923 19:38:46.231283 26627 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c1e0be704d774a1ea2c9313ce3a8b609: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:38:46.388851 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26350
I20260923 19:38:46.390054 26412 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:46.501641 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26350
W20260923 19:38:46.531836 26517 connection.cc:535] server connection from 127.0.0.1:42440 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:38:46.532251 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26424
I20260923 19:38:46.533473 26486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:46.648563 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26424
I20260923 19:38:46.668552 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26498
I20260923 19:38:46.669627 26560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:46.777288 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26498
2026-09-23T19:38:46Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4756 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:38:46 dist-test-slave-lzv7 krb5kdc[26643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:38:46 dist-test-slave-lzv7 krb5kdc[26643](info): set up 2 sockets
Sep 23 19:38:46 dist-test-slave-lzv7 krb5kdc[26643](info): commencing operation
krb5kdc: starting...
W20260923 19:38:47.958295 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.002s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:38:48 dist-test-slave-lzv7 krb5kdc[26643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:38:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:38:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:38:48.197026 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34249
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:34249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:48.542024 26656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:48.542429 26656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:48.542599 26656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:48.550283 26656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:48.550443 26656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:48.550558 26656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:48.550704 26656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:48.550801 26656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:48.561133 26656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:34249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:48.562602 26656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:48.564041 26656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:48.576601 26664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:48.576678 26661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:48.576678 26662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:48.577389 26656 server_base.cc:1034] running on GCE node
I20260923 19:38:48.578270 26656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:48.579733 26656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:48.580994 26656 hybrid_clock.cc:648] HybridClock initialized: now 1790192328580932 us; error 63 us; skew 500 ppm
I20260923 19:38:48.581399 26656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:48 dist-test-slave-lzv7 krb5kdc[26643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192328, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:48.584784 26656 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:38:48.586377 26656 webserver.cc:460] Webserver started at http://127.12.159.254:43413/ using document root <none> and password file <none>
I20260923 19:38:48.587077 26656 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:48.587239 26656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:48.587553 26656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:48.590694 26656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "627dfb045ef94922aadd6e259c04ca47"
format_stamp: "Formatted at 2026-09-23 19:38:48 on dist-test-slave-lzv7"
server_key: "dd893309e6e0c68256fd937a3cb931c4"
server_key_iv: "770783b5fed07ef6568a2cddaa5e30d8"
server_key_version: "encryptionkey@0"
I20260923 19:38:48.591507 26656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "627dfb045ef94922aadd6e259c04ca47"
format_stamp: "Formatted at 2026-09-23 19:38:48 on dist-test-slave-lzv7"
server_key: "dd893309e6e0c68256fd937a3cb931c4"
server_key_iv: "770783b5fed07ef6568a2cddaa5e30d8"
server_key_version: "encryptionkey@0"
I20260923 19:38:48.596899 26656 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260923 19:38:48.600551 26671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:48.602113 26656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:48.602319 26656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "627dfb045ef94922aadd6e259c04ca47"
format_stamp: "Formatted at 2026-09-23 19:38:48 on dist-test-slave-lzv7"
server_key: "dd893309e6e0c68256fd937a3cb931c4"
server_key_iv: "770783b5fed07ef6568a2cddaa5e30d8"
server_key_version: "encryptionkey@0"
I20260923 19:38:48.602572 26656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:48.617321 26656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:48.622211 26656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:48.622526 26656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:48.640738 26656 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:34249
I20260923 19:38:48.640740 26722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:34249 every 8 connection(s)
I20260923 19:38:48.642238 26656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:38:48.646034 26723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:48.650533 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26656
I20260923 19:38:48.650758 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:38:48.651582 12927 external_mini_cluster.cc:1428] Setting key f7a31923cccaeca87cd7b95016931bee
I20260923 19:38:48.658939 26723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47: Bootstrap starting.
I20260923 19:38:48.662629 26723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:48.663800 26723 log.cc:824] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:48.667508 26723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47: No bootstrap required, opened a new log
Sep 23 19:38:48 dist-test-slave-lzv7 krb5kdc[26643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:48.675424 26723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "627dfb045ef94922aadd6e259c04ca47" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34249 } }
I20260923 19:38:48.675839 26723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:48.675968 26723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 627dfb045ef94922aadd6e259c04ca47, State: Initialized, Role: FOLLOWER
I20260923 19:38:48.676656 26723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "627dfb045ef94922aadd6e259c04ca47" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34249 } }
I20260923 19:38:48.676935 26723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:38:48.677088 26723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:38:48.677291 26723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:48.677300 26726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:48.653456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34030 (local address 127.12.159.254:34249)
0923 19:38:48.654296 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:48.654310 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:48.654370 (+ 60us) server_negotiation.cc:407] Connection header received
0923 19:38:48.657252 (+ 2882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:48.657281 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:48.657835 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:48.658274 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:48.659772 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:48.661798 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:48.663278 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:48.664462 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:48.664660 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:48.669641 (+ 4981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:48.669648 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:48.669662 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:48.669703 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:48.672923 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:48.673658 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:48.673669 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:48.673675 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:48.673910 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:48.674282 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:48.674288 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:48.674291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:48.674847 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:48.675217 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:48.675671 (+ 454us) server_negotiation.cc:299] Negotiation successful
0923 19:38:48.676143 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":373,"threads_started":1}
I20260923 19:38:48.680298 26723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "627dfb045ef94922aadd6e259c04ca47" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34249 } }
I20260923 19:38:48.680938 26723 leader_election.cc:302] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 627dfb045ef94922aadd6e259c04ca47; no voters:
I20260923 19:38:48.681629 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:38:48.681623 26723 leader_election.cc:288] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:38:48.681742 26728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:38:48.683898 26723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:48.688730 26728 raft_consensus.cc:686] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [term 1 LEADER]: Becoming Leader. State: Replica: 627dfb045ef94922aadd6e259c04ca47, State: Running, Role: LEADER
I20260923 19:38:48.689528 26728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "627dfb045ef94922aadd6e259c04ca47" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34249 } }
I20260923 19:38:48.692956 26730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 627dfb045ef94922aadd6e259c04ca47. Latest consensus state: current_term: 1 leader_uuid: "627dfb045ef94922aadd6e259c04ca47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "627dfb045ef94922aadd6e259c04ca47" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34249 } } }
I20260923 19:38:48.693446 26730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:48.692945 26729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "627dfb045ef94922aadd6e259c04ca47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "627dfb045ef94922aadd6e259c04ca47" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34249 } } }
I20260923 19:38:48.693885 26729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47 [sys.catalog]: This master's current role is: LEADER
W20260923 19:38:48.698537 26742 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:38:48.698648 26742 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:38:48.698814 26743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:38:48.700356 26743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:38:48.708925 26743 catalog_manager.cc:1347] Generated new cluster ID: dca97e27fc724b15b607150205583988
I20260923 19:38:48.709043 26743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:38:48.744268 26743 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:38:48.746260 26743 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:38:48.756927 26743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 627dfb045ef94922aadd6e259c04ca47: Generated new TSK 0
I20260923 19:38:48.757890 26743 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:38:48.796310 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26656
I20260923 19:38:48.797618 26718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:48.896845 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26656
2026-09-23T19:38:48Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2112 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:38:48 dist-test-slave-lzv7 krb5kdc[26751](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:38:48 dist-test-slave-lzv7 krb5kdc[26751](info): set up 2 sockets
Sep 23 19:38:48 dist-test-slave-lzv7 krb5kdc[26751](info): commencing operation
krb5kdc: starting...
W20260923 19:38:50.022271 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:38:50 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:38:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:38:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:38:50.254376 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45659
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45659
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:50.608747 26764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:50.609058 26764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:50.609157 26764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:50.616680 26764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:50.616802 26764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:50.616855 26764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:50.616921 26764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:50.616972 26764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:50.627188 26764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:50.628500 26764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:50.629797 26764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:50.642652 26769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:50.642613 26772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:50.642701 26770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:50.655593 26764 server_base.cc:1034] running on GCE node
I20260923 19:38:50.656570 26764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:50.658285 26764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:50.659529 26764 hybrid_clock.cc:648] HybridClock initialized: now 1790192330659472 us; error 52 us; skew 500 ppm
I20260923 19:38:50.659904 26764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:50 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192330, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:50.663189 26764 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:38:50.664840 26764 webserver.cc:460] Webserver started at http://127.12.159.254:33201/ using document root <none> and password file <none>
I20260923 19:38:50.665623 26764 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:50.665772 26764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:50.666116 26764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:50.669103 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "a71e0aa99bd646cc85ab381e1bfe2d34"
format_stamp: "Formatted at 2026-09-23 19:38:50 on dist-test-slave-lzv7"
server_key: "09fdbe822f552030f059ca78d3cb6d5c"
server_key_iv: "dc9c57d818c6bd59e0f92d18f7fcabc8"
server_key_version: "encryptionkey@0"
I20260923 19:38:50.669919 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "a71e0aa99bd646cc85ab381e1bfe2d34"
format_stamp: "Formatted at 2026-09-23 19:38:50 on dist-test-slave-lzv7"
server_key: "09fdbe822f552030f059ca78d3cb6d5c"
server_key_iv: "dc9c57d818c6bd59e0f92d18f7fcabc8"
server_key_version: "encryptionkey@0"
I20260923 19:38:50.675112 26764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260923 19:38:50.678946 26779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:50.680365 26764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:38:50.680558 26764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "a71e0aa99bd646cc85ab381e1bfe2d34"
format_stamp: "Formatted at 2026-09-23 19:38:50 on dist-test-slave-lzv7"
server_key: "09fdbe822f552030f059ca78d3cb6d5c"
server_key_iv: "dc9c57d818c6bd59e0f92d18f7fcabc8"
server_key_version: "encryptionkey@0"
I20260923 19:38:50.680766 26764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:50.706707 26764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:50.710840 26764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:50.711136 26764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:50.730170 26764 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45659
I20260923 19:38:50.730204 26830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45659 every 8 connection(s)
I20260923 19:38:50.731541 26764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:38:50.735307 26831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:50.737298 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26764
I20260923 19:38:50.737510 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:38:50.738226 12927 external_mini_cluster.cc:1428] Setting key 23d794a8057f0a1ada73e052f9e14776
I20260923 19:38:50.747262 26831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Bootstrap starting.
I20260923 19:38:50.750733 26831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:50.751806 26831 log.cc:824] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:38:50 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:50.754976 26831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: No bootstrap required, opened a new log
I20260923 19:38:50.762177 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:50.740470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47090 (local address 127.12.159.254:45659)
0923 19:38:50.741329 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:50.741343 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:50.741388 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:38:50.743282 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:50.743309 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:50.743745 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:50.744229 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:50.745778 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:50.747218 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:50.748597 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:50.749325 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:50.749525 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:50.754322 (+ 4797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:50.754331 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:50.754347 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:50.754397 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:50.757514 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:50.758583 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:50.758591 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:50.758597 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:50.758792 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:50.759201 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:50.759208 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:50.759216 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:50.759776 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:50.760151 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:50.760585 (+ 434us) server_negotiation.cc:299] Negotiation successful
0923 19:38:50.761025 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":396,"threads_started":1}
I20260923 19:38:50.763387 26831 raft_consensus.cc:348] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:50.763768 26831 raft_consensus.cc:374] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:50.763881 26831 raft_consensus.cc:729] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a71e0aa99bd646cc85ab381e1bfe2d34, State: Initialized, Role: FOLLOWER
I20260923 19:38:50.764485 26831 consensus_queue.cc:260] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:50.764735 26831 raft_consensus.cc:388] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:38:50.764894 26831 raft_consensus.cc:482] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:38:50.765091 26831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:50.767457 26831 raft_consensus.cc:504] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:50.767959 26831 leader_election.cc:302] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a71e0aa99bd646cc85ab381e1bfe2d34; no voters:
I20260923 19:38:50.768545 26831 leader_election.cc:288] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:38:50.768694 26836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:38:50.769501 26836 raft_consensus.cc:686] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 LEADER]: Becoming Leader. State: Replica: a71e0aa99bd646cc85ab381e1bfe2d34, State: Running, Role: LEADER
I20260923 19:38:50.770154 26836 consensus_queue.cc:237] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:50.770955 26831 sys_catalog.cc:564] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:50.772927 26837 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } } }
I20260923 19:38:50.773335 26837 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:50.774333 26838 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a71e0aa99bd646cc85ab381e1bfe2d34. Latest consensus state: current_term: 1 leader_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } } }
I20260923 19:38:50.774735 26838 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:50.775141 26845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:38:50.779784 26845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:38:50.787868 26845 catalog_manager.cc:1347] Generated new cluster ID: 5311c514bf4448e982a8b9343e64305f
I20260923 19:38:50.787982 26845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:38:50.813220 26845 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:38:50.814955 26845 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:38:50.822077 26845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Generated new TSK 0
I20260923 19:38:50.822969 26845 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:38:50.883198 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45659
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:51.225286 26857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:51.225575 26857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:51.225739 26857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:51.233038 26857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:51.233212 26857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:51.233408 26857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:38:51.243587 26857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:51.244897 26857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:51.246294 26857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:51.259141 26863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:51.259224 26862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:51.259220 26865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:51.260334 26857 server_base.cc:1034] running on GCE node
I20260923 19:38:51.260972 26857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:51.264794 26857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:51.265977 26857 hybrid_clock.cc:648] HybridClock initialized: now 1790192331265917 us; error 61 us; skew 500 ppm
I20260923 19:38:51.266299 26857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:51 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:51.269567 26857 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:38:51.271070 26857 webserver.cc:460] Webserver started at http://127.12.159.193:39247/ using document root <none> and password file <none>
I20260923 19:38:51.271759 26857 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:51.271942 26857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:51.272274 26857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:51.275552 26857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "d63216c2973a4513ba54ccccfbfb38df"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "c0b4a5e9b82b46cdfcdcb4b1bf2be2fa"
server_key_iv: "fc0b9b87c8250ee54e75e7b2c0a9b7aa"
server_key_version: "encryptionkey@0"
I20260923 19:38:51.276345 26857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "d63216c2973a4513ba54ccccfbfb38df"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "c0b4a5e9b82b46cdfcdcb4b1bf2be2fa"
server_key_iv: "fc0b9b87c8250ee54e75e7b2c0a9b7aa"
server_key_version: "encryptionkey@0"
I20260923 19:38:51.281579 26857 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:38:51.285311 26872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:51.286885 26857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:51.287086 26857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "d63216c2973a4513ba54ccccfbfb38df"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "c0b4a5e9b82b46cdfcdcb4b1bf2be2fa"
server_key_iv: "fc0b9b87c8250ee54e75e7b2c0a9b7aa"
server_key_version: "encryptionkey@0"
I20260923 19:38:51.287309 26857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:51.316001 26857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:51.320537 26857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:51.320853 26857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:51.321877 26857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:51.323225 26857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:51.323333 26857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:51.323484 26857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:51.323567 26857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:51.356737 26857 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:36033
I20260923 19:38:51.356784 26984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:36033 every 8 connection(s)
I20260923 19:38:51.358107 26857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:38:51.366128 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26857
I20260923 19:38:51.366374 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:38:51.367198 12927 external_mini_cluster.cc:1428] Setting key ea9e8fc392016ce7d6f69e9b9501c8d0
Sep 23 19:38:51 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:51.381763 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:51.360797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:37023 (local address 127.12.159.254:45659)
0923 19:38:51.361232 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:51.361237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:51.362295 (+ 1058us) server_negotiation.cc:407] Connection header received
0923 19:38:51.364754 (+ 2459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:51.364759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:51.364902 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:51.365050 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:51.367214 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.368004 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.370139 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.370541 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.370648 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:51.375711 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:51.375717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:51.375720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:51.375756 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:51.378536 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:51.379298 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:51.379306 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:51.379315 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:51.379443 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:51.379933 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:51.379937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:51.379939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:51.380216 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:51.380381 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:51.381157 (+ 776us) server_negotiation.cc:299] Negotiation successful
0923 19:38:51.381401 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":227,"threads_started":1}
I20260923 19:38:51.382879 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:51.361386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:37023)
0923 19:38:51.362132 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:51.362178 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:51.364372 (+ 2194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:51.365341 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:51.365351 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:51.366118 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:51.367004 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:51.367033 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.368167 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.368173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:51.369980 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:51.369999 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.370795 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.370805 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:51.371197 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:51.371999 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:51.372036 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:51.375404 (+ 3368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:51.378690 (+ 3286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:51.378697 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:51.378712 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:51.379147 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:51.379577 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:51.379582 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:51.379586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:51.379789 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:51.380365 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:51.380374 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:51.380757 (+ 383us) client_negotiation.cc:769] Sending connection context
0923 19:38:51.381040 (+ 283us) client_negotiation.cc:240] Negotiation successful
0923 19:38:51.381625 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":335,"threads_started":1}
I20260923 19:38:51.384712 26985 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45659
I20260923 19:38:51.385080 26985 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:51.385965 26985 heartbeater.cc:511] Master 127.12.159.254:45659 requested a full tablet report, sending...
I20260923 19:38:51.388420 26796 ts_manager.cc:194] Registered new tserver with Master: d63216c2973a4513ba54ccccfbfb38df (127.12.159.193:36033)
I20260923 19:38:51.390769 26796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:37023
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:38:51.422817 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45659
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:51.757738 26991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:51.758116 26991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:51.758308 26991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:51.765761 26991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:51.765895 26991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:51.766088 26991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:38:51.776455 26991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:51.777833 26991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:51.779157 26991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:51.792402 26999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:51.792516 26996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:51.792505 26997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:51.798759 26991 server_base.cc:1034] running on GCE node
I20260923 19:38:51.799628 26991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:51.800649 26991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:51.801913 26991 hybrid_clock.cc:648] HybridClock initialized: now 1790192331801855 us; error 35 us; skew 500 ppm
I20260923 19:38:51.802223 26991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:51 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:51.805599 26991 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:38:51.807354 26991 webserver.cc:460] Webserver started at http://127.12.159.194:44735/ using document root <none> and password file <none>
I20260923 19:38:51.808091 26991 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:51.808244 26991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:51.808558 26991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:51.811908 26991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "2143c5bd2827443eaefb16a3fa373ffc"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "eb53ad328c1c2f405d7a8d891680d4d1"
server_key_iv: "72744ab049b2fa0a94de6ea2d76f3f62"
server_key_version: "encryptionkey@0"
I20260923 19:38:51.812798 26991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "2143c5bd2827443eaefb16a3fa373ffc"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "eb53ad328c1c2f405d7a8d891680d4d1"
server_key_iv: "72744ab049b2fa0a94de6ea2d76f3f62"
server_key_version: "encryptionkey@0"
I20260923 19:38:51.818764 26991 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260923 19:38:51.822484 27006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:51.823947 26991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:38:51.824151 26991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "2143c5bd2827443eaefb16a3fa373ffc"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "eb53ad328c1c2f405d7a8d891680d4d1"
server_key_iv: "72744ab049b2fa0a94de6ea2d76f3f62"
server_key_version: "encryptionkey@0"
I20260923 19:38:51.824404 26991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:51.842864 26991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:51.847249 26991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:51.847553 26991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:51.848522 26991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:51.850008 26991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:51.850113 26991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:51.850265 26991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:51.850338 26991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:51.885965 26991 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:43283
I20260923 19:38:51.886023 27118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:43283 every 8 connection(s)
I20260923 19:38:51.887226 26991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:38:51.895830 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 26991
I20260923 19:38:51.896066 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:38:51.896610 12927 external_mini_cluster.cc:1428] Setting key c1798718a636056a7750a7a33caafefb
Sep 23 19:38:51 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:51.911100 27121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:51.889962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:34569 (local address 127.12.159.254:45659)
0923 19:38:51.890438 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:51.890443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:51.891568 (+ 1125us) server_negotiation.cc:407] Connection header received
0923 19:38:51.893519 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:51.893525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:51.893619 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:51.893734 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:51.895427 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.896359 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.898671 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.899119 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.899219 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:51.904017 (+ 4798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:51.904027 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:51.904035 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:51.904088 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:51.907795 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:51.908606 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:51.908611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:51.908613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:51.908748 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:51.909275 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:51.909279 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:51.909281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:51.909549 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:51.909661 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:51.910625 (+ 964us) server_negotiation.cc:299] Negotiation successful
0923 19:38:51.910826 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":267,"threads_started":1}
I20260923 19:38:51.912665 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:51.890408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:34569)
0923 19:38:51.891350 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:51.891393 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:51.893209 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:51.894124 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:51.894132 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:51.894640 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:51.895238 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:51.895255 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.896522 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.896528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:51.898514 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:51.898539 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:51.899368 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:51.899379 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:51.899729 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:51.900617 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:51.900663 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:51.903719 (+ 3056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:51.907965 (+ 4246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:51.907975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:51.908001 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:51.908453 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:51.908871 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:51.908879 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:51.908886 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:51.909146 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:51.909677 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:51.909689 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:51.910208 (+ 519us) client_negotiation.cc:769] Sending connection context
0923 19:38:51.910514 (+ 306us) client_negotiation.cc:240] Negotiation successful
0923 19:38:51.911164 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":312,"threads_started":1}
I20260923 19:38:51.914391 27119 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45659
I20260923 19:38:51.914716 27119 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:51.915591 27119 heartbeater.cc:511] Master 127.12.159.254:45659 requested a full tablet report, sending...
I20260923 19:38:51.917066 26796 ts_manager.cc:194] Registered new tserver with Master: 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
I20260923 19:38:51.917954 26796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:34569
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:38:51.953382 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45659
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:52.282652 27125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:52.283000 27125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:52.283181 27125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:52.290798 27125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:52.290962 27125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:52.291203 27125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:38:52.301339 27125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:52.302752 27125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:52.304109 27125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:52.317461 27130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:52.317464 27131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:52.317446 27133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:52.318068 27125 server_base.cc:1034] running on GCE node
I20260923 19:38:52.318681 27125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:52.319631 27125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:52.320851 27125 hybrid_clock.cc:648] HybridClock initialized: now 1790192332320805 us; error 45 us; skew 500 ppm
I20260923 19:38:52.321121 27125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:52 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192332, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:52.324452 27125 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:38:52.326109 27125 webserver.cc:460] Webserver started at http://127.12.159.195:35329/ using document root <none> and password file <none>
I20260923 19:38:52.326797 27125 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:52.326905 27125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:52.327155 27125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:38:52.330343 27125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "b67db278cb2340c8baa900f1689f39a9"
format_stamp: "Formatted at 2026-09-23 19:38:52 on dist-test-slave-lzv7"
server_key: "f562372fcf526acd56710d47d76236d8"
server_key_iv: "5f80aa6e4851bf2f5e2b7de99677a8f0"
server_key_version: "encryptionkey@0"
I20260923 19:38:52.331055 27125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "b67db278cb2340c8baa900f1689f39a9"
format_stamp: "Formatted at 2026-09-23 19:38:52 on dist-test-slave-lzv7"
server_key: "f562372fcf526acd56710d47d76236d8"
server_key_iv: "5f80aa6e4851bf2f5e2b7de99677a8f0"
server_key_version: "encryptionkey@0"
I20260923 19:38:52.336279 27125 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:38:52.339692 27140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:52.341025 27125 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:38:52.341214 27125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "b67db278cb2340c8baa900f1689f39a9"
format_stamp: "Formatted at 2026-09-23 19:38:52 on dist-test-slave-lzv7"
server_key: "f562372fcf526acd56710d47d76236d8"
server_key_iv: "5f80aa6e4851bf2f5e2b7de99677a8f0"
server_key_version: "encryptionkey@0"
I20260923 19:38:52.341406 27125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:52.363829 27125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:52.368857 27125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:52.369180 27125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:52.370505 27125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:52.372108 27125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:52.372186 27125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:52.372331 27125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:52.372380 27125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:52.394387 26985 heartbeater.cc:503] Master 127.12.159.254:45659 was elected leader, sending a full tablet report...
I20260923 19:38:52.407033 27125 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:33411
I20260923 19:38:52.407076 27252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:33411 every 8 connection(s)
I20260923 19:38:52.408468 27125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:38:52.416122 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 27125
I20260923 19:38:52.416316 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:38:52.416827 12927 external_mini_cluster.cc:1428] Setting key df481d05e57840e77c5b276dfd481cf2
Sep 23 19:38:52 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192332, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:52.427932 27121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.411159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:45709 (local address 127.12.159.254:45659)
0923 19:38:52.411344 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.411348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.412470 (+ 1122us) server_negotiation.cc:407] Connection header received
0923 19:38:52.414335 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.414342 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.414448 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.414572 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:52.416108 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.417158 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.418896 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.419314 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.419448 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.422834 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:52.422839 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:52.422843 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:52.422876 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:52.425276 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:52.426011 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:52.426015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:52.426017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:52.426125 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:52.426505 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:52.426508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:52.426510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:52.426768 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:52.426894 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.427546 (+ 652us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.427712 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:38:52.428993 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.411597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:45709)
0923 19:38:52.412305 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:52.412351 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:52.414066 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:52.414818 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:52.414826 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:52.415342 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:52.415927 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.415949 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.417306 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.417312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.418738 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.418758 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.419541 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.419547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.419798 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.420380 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:52.420402 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:52.422627 (+ 2225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:52.425411 (+ 2784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:52.425418 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:52.425430 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:52.425907 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:52.426215 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:52.426218 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:52.426220 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:52.426407 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:52.426874 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:52.426880 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:52.427218 (+ 338us) client_negotiation.cc:769] Sending connection context
0923 19:38:52.427451 (+ 233us) client_negotiation.cc:240] Negotiation successful
0923 19:38:52.427836 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":283,"threads_started":1}
I20260923 19:38:52.430472 27253 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45659
I20260923 19:38:52.430802 27253 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:52.431533 27253 heartbeater.cc:511] Master 127.12.159.254:45659 requested a full tablet report, sending...
I20260923 19:38:52.432971 26796 ts_manager.cc:194] Registered new tserver with Master: b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411)
I20260923 19:38:52.433789 26796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:45709
I20260923 19:38:52.444082 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:38:52.461045 27121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.448733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47098 (local address 127.12.159.254:45659)
0923 19:38:52.448894 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.448899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.449344 (+ 445us) server_negotiation.cc:407] Connection header received
0923 19:38:52.449498 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.449502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.449574 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.449657 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:52.451113 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.451845 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.453141 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.453523 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.453612 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.456068 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:52.456073 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:52.456076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:52.456106 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:52.458752 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:52.459364 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:52.459368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:52.459370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:52.459478 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:52.459788 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:52.459791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:52.459793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:52.460085 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:52.460275 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.460523 (+ 248us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.460685 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:38:52.465073 26796 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:38:52.472195 26796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:38:52.508546 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.484447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:35964)
0923 19:38:52.485578 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:52.485621 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:52.485836 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:52.498991 (+ 13155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:52.499004 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:52.499057 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:52.499655 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.499674 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.502494 (+ 2820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.502505 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.505171 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.505196 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.507426 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.507432 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.507666 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.507732 (+ 66us) client_negotiation.cc:769] Sending connection context
0923 19:38:52.507930 (+ 198us) client_negotiation.cc:240] Negotiation successful
0923 19:38:52.508157 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":875,"thread_start_us":1144,"threads_started":1}
I20260923 19:38:52.508528 27267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.484738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35964 (local address 127.12.159.193:36033)
0923 19:38:52.497365 (+ 12627us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.497379 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.497428 (+ 49us) server_negotiation.cc:407] Connection header received
0923 19:38:52.497590 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.497604 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.498283 (+ 679us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.498584 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:52.500038 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.502274 (+ 2236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.505350 (+ 3076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.506893 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.507097 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.507319 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.507981 (+ 662us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.508156 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12316,"thread_start_us":13041,"threads_started":1}
I20260923 19:38:52.512660 27268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.485305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60918 (local address 127.12.159.195:33411)
0923 19:38:52.504041 (+ 18736us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.504053 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.504096 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:38:52.504217 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.504228 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.504566 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.504783 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:52.505459 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.507057 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.509724 (+ 2667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.511204 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.511430 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.511633 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.512163 (+ 530us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.512325 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18505,"thread_start_us":18751,"threads_started":1}
I20260923 19:38:52.512774 27269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.484730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33411 (local address 127.0.0.1:60918)
0923 19:38:52.503140 (+ 18410us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:52.503169 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:52.503333 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:52.504760 (+ 1427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:52.504764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:52.504790 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:52.505210 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.505220 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.507208 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.507212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.509541 (+ 2329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.509558 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.511778 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.511784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.511980 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.512021 (+ 41us) client_negotiation.cc:769] Sending connection context
0923 19:38:52.512120 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 19:38:52.512298 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18210,"mutex_wait_us":1,"thread_start_us":19696,"threads_started":1}
I20260923 19:38:52.513101 27266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.486381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43283 (local address 127.0.0.1:51602)
0923 19:38:52.504718 (+ 18337us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:52.504740 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:52.504871 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:52.505563 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:52.505567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:52.505594 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:52.505969 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.505979 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.507909 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.507915 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.510057 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.510072 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.512009 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.512014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.512179 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.512235 (+ 56us) client_negotiation.cc:769] Sending connection context
0923 19:38:52.512301 (+ 66us) client_negotiation.cc:240] Negotiation successful
0923 19:38:52.512421 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18197,"mutex_wait_us":20,"thread_start_us":16330,"threads_started":1}
I20260923 19:38:52.513420 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.486680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51602 (local address 127.12.159.194:43283)
0923 19:38:52.502079 (+ 15399us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.502091 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.505008 (+ 2917us) server_negotiation.cc:407] Connection header received
0923 19:38:52.505123 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.505130 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.505382 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.505584 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:52.506195 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.507752 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.510248 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.511698 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.511879 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.512035 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.512860 (+ 825us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.513048 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15185,"thread_start_us":15393,"threads_started":1}
I20260923 19:38:52.513339 26920 tablet_service.cc:1467] Processing CreateTablet for tablet 31d2878eaac9478ca0fe1e69895d9b6d (DEFAULT_TABLE table=test-table [id=075fc4f305c24b8d89950c7e2a781449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:52.515084 26920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d2878eaac9478ca0fe1e69895d9b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:52.516513 27054 tablet_service.cc:1467] Processing CreateTablet for tablet 31d2878eaac9478ca0fe1e69895d9b6d (DEFAULT_TABLE table=test-table [id=075fc4f305c24b8d89950c7e2a781449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:52.516970 27188 tablet_service.cc:1467] Processing CreateTablet for tablet 31d2878eaac9478ca0fe1e69895d9b6d (DEFAULT_TABLE table=test-table [id=075fc4f305c24b8d89950c7e2a781449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:52.517797 27054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d2878eaac9478ca0fe1e69895d9b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:52.518273 27188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d2878eaac9478ca0fe1e69895d9b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:52.534677 27273 tablet_bootstrap.cc:492] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Bootstrap starting.
I20260923 19:38:52.536715 27272 tablet_bootstrap.cc:492] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Bootstrap starting.
I20260923 19:38:52.537501 27271 tablet_bootstrap.cc:492] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Bootstrap starting.
I20260923 19:38:52.538693 27273 tablet_bootstrap.cc:654] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:52.540702 27273 log.cc:824] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:52.540853 27272 tablet_bootstrap.cc:654] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:52.541143 27271 tablet_bootstrap.cc:654] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:52.542169 27272 log.cc:824] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:52.542436 27271 log.cc:824] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:52.544068 27273 tablet_bootstrap.cc:492] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: No bootstrap required, opened a new log
I20260923 19:38:52.544363 27273 ts_tablet_manager.cc:1397] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260923 19:38:52.545209 27271 tablet_bootstrap.cc:492] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: No bootstrap required, opened a new log
I20260923 19:38:52.545336 27272 tablet_bootstrap.cc:492] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: No bootstrap required, opened a new log
I20260923 19:38:52.545619 27271 ts_tablet_manager.cc:1397] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:38:52.545648 27272 ts_tablet_manager.cc:1397] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:38:52.553284 27271 raft_consensus.cc:348] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.553754 27271 raft_consensus.cc:374] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:52.553900 27271 raft_consensus.cc:729] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63216c2973a4513ba54ccccfbfb38df, State: Initialized, Role: FOLLOWER
I20260923 19:38:52.554553 27271 consensus_queue.cc:260] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.555660 27273 raft_consensus.cc:348] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.556138 27273 raft_consensus.cc:374] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:52.556298 27273 raft_consensus.cc:729] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2143c5bd2827443eaefb16a3fa373ffc, State: Initialized, Role: FOLLOWER
I20260923 19:38:52.556387 27271 ts_tablet_manager.cc:1428] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Time spent starting tablet: real 0.011s user 0.006s sys 0.003s
I20260923 19:38:52.556214 27272 raft_consensus.cc:348] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.556663 27272 raft_consensus.cc:374] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:52.556775 27272 raft_consensus.cc:729] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67db278cb2340c8baa900f1689f39a9, State: Initialized, Role: FOLLOWER
I20260923 19:38:52.557036 27273 consensus_queue.cc:260] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.557358 27272 consensus_queue.cc:260] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.558241 27119 heartbeater.cc:503] Master 127.12.159.254:45659 was elected leader, sending a full tablet report...
I20260923 19:38:52.559212 27273 ts_tablet_manager.cc:1428] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260923 19:38:52.560220 27253 heartbeater.cc:503] Master 127.12.159.254:45659 was elected leader, sending a full tablet report...
I20260923 19:38:52.560864 27272 ts_tablet_manager.cc:1428] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260923 19:38:52.610966 26986 tablet.cc:2369] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:38:52.639211 27120 tablet.cc:2369] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:38:52.660061 27254 tablet.cc:2369] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:38:52.823747 27277 raft_consensus.cc:482] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:38:52.824133 27277 raft_consensus.cc:504] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.826210 27277 leader_election.cc:288] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
I20260923 19:38:52.836086 27268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.826703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:52325 (local address 127.12.159.195:33411)
0923 19:38:52.826910 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.826916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.827673 (+ 757us) server_negotiation.cc:407] Connection header received
0923 19:38:52.827891 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.827897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.827976 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.828079 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:52.829102 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.830364 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.833556 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.834886 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.835042 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.835124 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.835715 (+ 591us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.835839 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:38:52.836086 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.826687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:41655 (local address 127.12.159.194:43283)
0923 19:38:52.826909 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.826916 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.827691 (+ 775us) server_negotiation.cc:407] Connection header received
0923 19:38:52.827891 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.827897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.827976 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.828079 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:52.829118 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.830378 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.833557 (+ 3179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.834869 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.835042 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.835137 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.835671 (+ 534us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.835808 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 19:38:52.836328 27280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.826552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33411 (local address 127.12.159.193:52325)
0923 19:38:52.827534 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:52.827553 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:52.827730 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:52.828110 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:52.828115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:52.828175 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:52.828911 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.828933 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.830565 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.830574 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.833369 (+ 2795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.833381 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.835140 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.835148 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.835421 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.835513 (+ 92us) client_negotiation.cc:769] Sending connection context
0923 19:38:52.835616 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 19:38:52.835788 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"mutex_wait_us":377,"spinlock_wait_cycles":82816,"thread_start_us":545,"threads_started":1}
I20260923 19:38:52.836373 27281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.826688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43283 (local address 127.12.159.193:41655)
0923 19:38:52.827532 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:52.827553 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:52.827730 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:52.828110 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:52.828115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:52.828175 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:52.828967 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.828979 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.830568 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.830573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.833365 (+ 2792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:52.833381 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.835156 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.835161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:52.835424 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.835522 (+ 98us) client_negotiation.cc:769] Sending connection context
0923 19:38:52.835616 (+ 94us) client_negotiation.cc:240] Negotiation successful
0923 19:38:52.835788 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":369,"spinlock_wait_cycles":40448,"thread_start_us":454,"threads_started":1}
I20260923 19:38:52.837642 27208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d2878eaac9478ca0fe1e69895d9b6d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67db278cb2340c8baa900f1689f39a9" is_pre_election: true
I20260923 19:38:52.837702 27074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d2878eaac9478ca0fe1e69895d9b6d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2143c5bd2827443eaefb16a3fa373ffc" is_pre_election: true
I20260923 19:38:52.838300 27074 raft_consensus.cc:2454] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 0.
I20260923 19:38:52.838299 27208 raft_consensus.cc:2454] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 0.
I20260923 19:38:52.839160 26873 leader_election.cc:302] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2143c5bd2827443eaefb16a3fa373ffc, b67db278cb2340c8baa900f1689f39a9, d63216c2973a4513ba54ccccfbfb38df; no voters:
I20260923 19:38:52.839692 27277 raft_consensus.cc:2781] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:38:52.839875 27277 raft_consensus.cc:482] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:38:52.840008 27277 raft_consensus.cc:3037] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:52.842506 27277 raft_consensus.cc:504] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.843110 27277 leader_election.cc:288] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 election: Requested vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
I20260923 19:38:52.843636 27208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d2878eaac9478ca0fe1e69895d9b6d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67db278cb2340c8baa900f1689f39a9"
I20260923 19:38:52.843751 27074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d2878eaac9478ca0fe1e69895d9b6d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2143c5bd2827443eaefb16a3fa373ffc"
I20260923 19:38:52.843847 27208 raft_consensus.cc:3037] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:52.843997 27074 raft_consensus.cc:3037] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:52.846462 27208 raft_consensus.cc:2454] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 1.
I20260923 19:38:52.846616 27074 raft_consensus.cc:2454] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 1.
I20260923 19:38:52.846997 26873 leader_election.cc:302] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67db278cb2340c8baa900f1689f39a9, d63216c2973a4513ba54ccccfbfb38df; no voters:
I20260923 19:38:52.847424 27277 raft_consensus.cc:2781] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:38:52.847885 27277 raft_consensus.cc:686] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 1 LEADER]: Becoming Leader. State: Replica: d63216c2973a4513ba54ccccfbfb38df, State: Running, Role: LEADER
I20260923 19:38:52.848453 27277 consensus_queue.cc:237] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:52.852995 26794 catalog_manager.cc:5495] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df reported cstate change: term changed from 0 to 1, leader changed from <none> to d63216c2973a4513ba54ccccfbfb38df (127.12.159.193). New cstate: current_term: 1 leader_uuid: "d63216c2973a4513ba54ccccfbfb38df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } health_report { overall_health: UNKNOWN } } }
I20260923 19:38:52.889849 27267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.883348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35980 (local address 127.12.159.193:36033)
0923 19:38:52.883559 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.883565 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.883635 (+ 70us) server_negotiation.cc:407] Connection header received
0923 19:38:52.883886 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.883891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.884028 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.884183 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:38:52.884574 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.885578 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.887373 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.887987 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.888109 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.888588 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:38:52.889233 (+ 645us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:38:52.889384 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.889440 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.889536 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:38:52.899235 27074 raft_consensus.cc:1261] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Refusing update from remote peer d63216c2973a4513ba54ccccfbfb38df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:52.899237 27208 raft_consensus.cc:1261] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Refusing update from remote peer d63216c2973a4513ba54ccccfbfb38df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:52.900166 27277 consensus_queue.cc:1035] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:52.900548 27282 consensus_queue.cc:1035] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [LEADER]: Connected to new peer: Peer: permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:52.932166 26796 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:38:52.932577 26796 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:38:52.936452 26796 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Sending DeleteTablet for 3 replicas of tablet 31d2878eaac9478ca0fe1e69895d9b6d
I20260923 19:38:52.937893 27188 tablet_service.cc:1514] Processing DeleteTablet for tablet 31d2878eaac9478ca0fe1e69895d9b6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:52 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:60918
I20260923 19:38:52.937875 26920 tablet_service.cc:1514] Processing DeleteTablet for tablet 31d2878eaac9478ca0fe1e69895d9b6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:52 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:35964
I20260923 19:38:52.938066 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26857
I20260923 19:38:52.937984 27054 tablet_service.cc:1514] Processing DeleteTablet for tablet 31d2878eaac9478ca0fe1e69895d9b6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:52 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51602
I20260923 19:38:52.950341 27296 tablet_replica.cc:330] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: stopping tablet replica
I20260923 19:38:52.951576 27296 raft_consensus.cc:2229] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:38:52.953845 27296 raft_consensus.cc:2258] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:52.954348 27295 tablet_replica.cc:330] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: stopping tablet replica
Sep 23 19:38:52 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:38:52.954826 27295 raft_consensus.cc:2229] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:38:52.955418 27295 raft_consensus.cc:2258] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:52.956605 27296 ts_tablet_manager.cc:1905] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:52.957633 27295 ts_tablet_manager.cc:1905] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:52.960908 27297 tablet_replica.cc:330] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: stopping tablet replica
I20260923 19:38:52.961355 27297 raft_consensus.cc:2229] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:38:52.961964 27297 raft_consensus.cc:2258] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:52.964205 27297 ts_tablet_manager.cc:1905] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:52.964735 27295 ts_tablet_manager.cc:1918] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:52.965353 27267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:52.939527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35988 (local address 127.12.159.193:36033)
0923 19:38:52.939770 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:52.939779 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:52.939863 (+ 84us) server_negotiation.cc:407] Connection header received
0923 19:38:52.940176 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:52.940185 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:52.940299 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:52.940388 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:52.943101 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.944687 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.947444 (+ 2757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:52.948576 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:52.948705 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:52.956371 (+ 7666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:52.956393 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:52.956416 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:52.956487 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:52.961400 (+ 4913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:52.962433 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:52.962444 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:52.962450 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:52.962659 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:52.963210 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:52.963215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:52.963232 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:52.963721 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:52.964013 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:52.964696 (+ 683us) server_negotiation.cc:299] Negotiation successful
0923 19:38:52.964962 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:38:52.966013 27296 ts_tablet_manager.cc:1918] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:52.966216 27296 log.cc:1196] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/31d2878eaac9478ca0fe1e69895d9b6d
I20260923 19:38:52.966825 27296 ts_tablet_manager.cc:1939] T 31d2878eaac9478ca0fe1e69895d9b6d P d63216c2973a4513ba54ccccfbfb38df: Deleting consensus metadata
I20260923 19:38:52.966933 26980 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:52.967386 27295 log.cc:1196] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/31d2878eaac9478ca0fe1e69895d9b6d
I20260923 19:38:52.967968 27295 ts_tablet_manager.cc:1939] T 31d2878eaac9478ca0fe1e69895d9b6d P b67db278cb2340c8baa900f1689f39a9: Deleting consensus metadata
I20260923 19:38:52.969944 26780 catalog_manager.cc:4841] TS b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411): tablet 31d2878eaac9478ca0fe1e69895d9b6d (table test-table [id=075fc4f305c24b8d89950c7e2a781449]) successfully deleted
I20260923 19:38:52.972530 27297 ts_tablet_manager.cc:1918] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:52.972699 27297 log.cc:1196] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/31d2878eaac9478ca0fe1e69895d9b6d
I20260923 19:38:52.973201 27297 ts_tablet_manager.cc:1939] T 31d2878eaac9478ca0fe1e69895d9b6d P 2143c5bd2827443eaefb16a3fa373ffc: Deleting consensus metadata
I20260923 19:38:52.975142 26781 catalog_manager.cc:4841] TS 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283): tablet 31d2878eaac9478ca0fe1e69895d9b6d (table test-table [id=075fc4f305c24b8d89950c7e2a781449]) successfully deleted
I20260923 19:38:53.067724 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26857
I20260923 19:38:53.067816 26781 catalog_manager.cc:4841] TS d63216c2973a4513ba54ccccfbfb38df (127.12.159.193:36033): tablet 31d2878eaac9478ca0fe1e69895d9b6d (table test-table [id=075fc4f305c24b8d89950c7e2a781449]) successfully deleted
I20260923 19:38:53.086483 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26991
Sep 23 19:38:53 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:38:53.107353 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:53.087241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51616 (local address 127.12.159.194:43283)
0923 19:38:53.087474 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:53.087482 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:53.087596 (+ 114us) server_negotiation.cc:407] Connection header received
0923 19:38:53.087846 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:53.087852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:53.087935 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:53.088051 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:53.089473 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:53.090378 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:53.091836 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:53.092293 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:53.092470 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:53.101709 (+ 9239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:53.101726 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:53.101742 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:53.101789 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:53.104723 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:53.105454 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:53.105460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:53.105463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:53.105592 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:53.106012 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:53.106015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:53.106017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:53.106394 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:53.106616 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:53.106903 (+ 287us) server_negotiation.cc:299] Negotiation successful
0923 19:38:53.107064 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:38:53.108017 27114 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:53.198371 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26991
I20260923 19:38:53.215448 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 27125
Sep 23 19:38:53 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:38:53.231153 27268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:53.216282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60922 (local address 127.12.159.195:33411)
0923 19:38:53.216463 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:53.216468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:53.216486 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:38:53.216677 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:53.216682 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:53.216760 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:53.216852 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:53.218080 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:53.218834 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:53.220041 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:53.220456 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:53.220590 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:53.224899 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:53.224917 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:53.224932 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:53.224968 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:53.227920 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:53.228601 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:53.228609 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:53.228611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:53.228753 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:53.229290 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:53.229298 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:53.229302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:53.229703 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:53.230091 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:53.230582 (+ 491us) server_negotiation.cc:299] Negotiation successful
0923 19:38:53.230795 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:38:53.231928 27248 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:53.324507 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 27125
I20260923 19:38:53.341301 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 26764
I20260923 19:38:53.342703 26826 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:53.462378 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 26764
I20260923 19:38:53.483974 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45659
--webserver_interface=127.12.159.254
--webserver_port=33201
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:53.844193 27303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:53.844515 27303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:53.844606 27303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:53.852296 27303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:53.852421 27303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:53.852469 27303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:53.852528 27303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:53.852566 27303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:53.862712 27303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=33201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:53.864044 27303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:53.865309 27303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:53.888692 27310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:53.888728 27312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:53.888656 27309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:53.889588 27303 server_base.cc:1034] running on GCE node
I20260923 19:38:53.890551 27303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:53.892129 27303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:53.893332 27303 hybrid_clock.cc:648] HybridClock initialized: now 1790192333893255 us; error 65 us; skew 500 ppm
I20260923 19:38:53.893690 27303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:53 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192333, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:53.897275 27303 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:38:53.899031 27303 webserver.cc:460] Webserver started at http://127.12.159.254:33201/ using document root <none> and password file <none>
I20260923 19:38:53.899834 27303 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:53.899996 27303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:53.906188 27303 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260923 19:38:53.909122 27319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:53.910537 27303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:53.910732 27303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "a71e0aa99bd646cc85ab381e1bfe2d34"
format_stamp: "Formatted at 2026-09-23 19:38:50 on dist-test-slave-lzv7"
server_key: "09fdbe822f552030f059ca78d3cb6d5c"
server_key_iv: "dc9c57d818c6bd59e0f92d18f7fcabc8"
server_key_version: "encryptionkey@0"
I20260923 19:38:53.911787 27303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:53.930249 27303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:53.934414 27303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:53.934793 27303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:53.954281 27303 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45659
I20260923 19:38:53.954300 27370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45659 every 8 connection(s)
I20260923 19:38:53.955920 27303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:38:53.958942 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 27303
I20260923 19:38:53.959785 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:36033
--local_ip_for_outbound_sockets=127.12.159.193
--tserver_master_addrs=127.12.159.254:45659
--webserver_port=39247
--webserver_interface=127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:38:53.963196 27371 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:38:53.966648 27371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Bootstrap starting.
I20260923 19:38:53.986666 27371 log.cc:824] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:53.998901 27371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:38:53.999444 27371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Bootstrap complete.
I20260923 19:38:54.008697 27371 raft_consensus.cc:348] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:54.009526 27371 raft_consensus.cc:729] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a71e0aa99bd646cc85ab381e1bfe2d34, State: Initialized, Role: FOLLOWER
I20260923 19:38:54.010241 27371 consensus_queue.cc:260] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:54.010494 27371 raft_consensus.cc:388] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:38:54.010619 27371 raft_consensus.cc:482] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:38:54.010818 27371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:38:54.014791 27371 raft_consensus.cc:504] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:54.015341 27371 leader_election.cc:302] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a71e0aa99bd646cc85ab381e1bfe2d34; no voters:
I20260923 19:38:54.015992 27371 leader_election.cc:288] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:38:54.016193 27375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:38:54.018074 27375 raft_consensus.cc:686] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 LEADER]: Becoming Leader. State: Replica: a71e0aa99bd646cc85ab381e1bfe2d34, State: Running, Role: LEADER
I20260923 19:38:54.018373 27371 sys_catalog.cc:564] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:54.018743 27375 consensus_queue.cc:237] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:54.024158 27377 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a71e0aa99bd646cc85ab381e1bfe2d34. Latest consensus state: current_term: 2 leader_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } } }
I20260923 19:38:54.024536 27377 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:54.024969 27376 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } } }
I20260923 19:38:54.025243 27376 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:54.034795 27388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:38:54.042147 27388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:38:54.043264 27388 catalog_manager.cc:1259] Loaded cluster ID: 5311c514bf4448e982a8b9343e64305f
I20260923 19:38:54.043381 27388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:38:54.045704 27388 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260923 19:38:54.056703 27388 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260923 19:38:54.063943 27388 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:38:54.065315 27388 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Loaded TSK: 0
I20260923 19:38:54.066591 27388 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 19:38:54.344285 27373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:54.344564 27373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:54.344728 27373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:54.352319 27373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:54.352429 27373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:54.352663 27373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:38:54.362679 27373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:36033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=39247
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:54.364060 27373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:54.365444 27373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:54.380795 27399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:54.381027 27401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:54.381971 27373 server_base.cc:1034] running on GCE node
W20260923 19:38:54.382243 27398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:54.383126 27373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:54.384631 27373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:54.385916 27373 hybrid_clock.cc:648] HybridClock initialized: now 1790192334385849 us; error 55 us; skew 500 ppm
I20260923 19:38:54.386270 27373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:54 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192334, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:54.394745 27373 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:38:54.396714 27373 webserver.cc:460] Webserver started at http://127.12.159.193:39247/ using document root <none> and password file <none>
I20260923 19:38:54.397658 27373 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:54.397861 27373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:54.406114 27373 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.002s
I20260923 19:38:54.409791 27408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:54.411686 27373 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:38:54.411878 27373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "d63216c2973a4513ba54ccccfbfb38df"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "c0b4a5e9b82b46cdfcdcb4b1bf2be2fa"
server_key_iv: "fc0b9b87c8250ee54e75e7b2c0a9b7aa"
server_key_version: "encryptionkey@0"
I20260923 19:38:54.413317 27373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:54.434410 27373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:54.440565 27373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:54.440889 27373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:54.442185 27373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:54.443950 27373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:54.444072 27373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:54.444191 27373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:54.444275 27373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:54.482957 27520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:36033 every 8 connection(s)
I20260923 19:38:54.483322 27373 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:36033
I20260923 19:38:54.484948 27373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:38:54.494024 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 27373
I20260923 19:38:54.494665 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:43283
--local_ip_for_outbound_sockets=127.12.159.194
--tserver_master_addrs=127.12.159.254:45659
--webserver_port=44735
--webserver_interface=127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:38:54 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192334, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:54.509367 27523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:54.487985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:36113 (local address 127.12.159.254:45659)
0923 19:38:54.488666 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:54.488678 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:54.489318 (+ 640us) server_negotiation.cc:407] Connection header received
0923 19:38:54.491531 (+ 2213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:54.491543 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:54.491881 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:54.492202 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:54.493708 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.495229 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.496863 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.497535 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.497772 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:54.501539 (+ 3767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:54.501547 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:54.501565 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:54.501606 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:54.504656 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:54.505469 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:54.505477 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:54.505483 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:54.505642 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:54.506136 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:54.506142 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:54.506145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:54.506629 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:54.506846 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:54.507629 (+ 783us) server_negotiation.cc:299] Negotiation successful
0923 19:38:54.508048 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":313,"threads_started":1}
I20260923 19:38:54.509368 27524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:54.488234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:36113)
0923 19:38:54.489128 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:54.489174 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:54.491039 (+ 1865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:54.492354 (+ 1315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:54.492362 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:54.492886 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:54.493447 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:54.493466 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.495414 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.495420 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:54.496693 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:54.496706 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.497828 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.497837 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:54.498128 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:54.498880 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:54.498905 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:54.501217 (+ 2312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:54.504838 (+ 3621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:54.504849 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:54.504865 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:54.505313 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:54.505765 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:54.505772 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:54.505778 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:54.506014 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:54.506774 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:54.506782 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:54.507128 (+ 346us) client_negotiation.cc:769] Sending connection context
0923 19:38:54.507411 (+ 283us) client_negotiation.cc:240] Negotiation successful
0923 19:38:54.507998 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":355,"threads_started":1}
I20260923 19:38:54.512862 27521 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45659
I20260923 19:38:54.513305 27521 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:54.514436 27521 heartbeater.cc:511] Master 127.12.159.254:45659 requested a full tablet report, sending...
I20260923 19:38:54.517381 27336 ts_manager.cc:194] Registered new tserver with Master: d63216c2973a4513ba54ccccfbfb38df (127.12.159.193:36033)
I20260923 19:38:54.520009 27336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:36113
W20260923 19:38:54.831926 27525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:54.832232 27525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:54.832425 27525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:54.840200 27525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:54.840325 27525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:54.840504 27525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:38:54.851056 27525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:43283
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=44735
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:54.852424 27525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:54.853849 27525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:54.867727 27530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:54.867854 27533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:54.868037 27531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:54.868633 27525 server_base.cc:1034] running on GCE node
I20260923 19:38:54.869221 27525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:54.870303 27525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:54.871534 27525 hybrid_clock.cc:648] HybridClock initialized: now 1790192334871465 us; error 71 us; skew 500 ppm
I20260923 19:38:54.871937 27525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:54 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192334, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:54.875540 27525 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:38:54.877406 27525 webserver.cc:460] Webserver started at http://127.12.159.194:44735/ using document root <none> and password file <none>
I20260923 19:38:54.878257 27525 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:54.878425 27525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:54.884336 27525 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260923 19:38:54.887300 27540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:54.888917 27525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:38:54.889222 27525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "2143c5bd2827443eaefb16a3fa373ffc"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "eb53ad328c1c2f405d7a8d891680d4d1"
server_key_iv: "72744ab049b2fa0a94de6ea2d76f3f62"
server_key_version: "encryptionkey@0"
I20260923 19:38:54.890450 27525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:54.914626 27525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:54.919816 27525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:54.920166 27525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:54.921327 27525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:54.923082 27525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:54.923209 27525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:54.923372 27525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:54.923476 27525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:54.960744 27525 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:43283
I20260923 19:38:54.960796 27652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:43283 every 8 connection(s)
I20260923 19:38:54.962388 27525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:38:54.967849 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 27525
I20260923 19:38:54.968518 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:33411
--local_ip_for_outbound_sockets=127.12.159.195
--tserver_master_addrs=127.12.159.254:45659
--webserver_port=35329
--webserver_interface=127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:38:54 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192334, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:54.987624 27523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:54.965335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:45697 (local address 127.12.159.254:45659)
0923 19:38:54.965585 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:54.965592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:54.966971 (+ 1379us) server_negotiation.cc:407] Connection header received
0923 19:38:54.969880 (+ 2909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:54.969889 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:54.970022 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:54.970151 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:54.972162 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.973476 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.975160 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.975827 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.975934 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:54.980199 (+ 4265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:54.980208 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:54.980216 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:54.980264 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:54.983974 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:54.984804 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:54.984812 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:54.984818 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:54.984986 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:54.985443 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:54.985450 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:54.985456 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:54.985932 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:54.986094 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:54.986894 (+ 800us) server_negotiation.cc:299] Negotiation successful
0923 19:38:54.987188 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 19:38:54.988462 27655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:54.965945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:45697)
0923 19:38:54.966775 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:54.966831 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:54.969500 (+ 2669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:54.970436 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:54.970448 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:54.971153 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:54.971945 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:54.971968 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.973661 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.973665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:54.974985 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:54.974998 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:54.976087 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:54.976095 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:54.976432 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:54.977229 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:54.977267 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:54.979960 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:54.984139 (+ 4179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:54.984147 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:54.984162 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:54.984618 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:54.985101 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:54.985105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:54.985107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:54.985303 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:54.986061 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:54.986068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:54.986422 (+ 354us) client_negotiation.cc:769] Sending connection context
0923 19:38:54.986738 (+ 316us) client_negotiation.cc:240] Negotiation successful
0923 19:38:54.987168 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":295,"threads_started":1}
I20260923 19:38:54.990146 27653 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45659
I20260923 19:38:54.990471 27653 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:54.991227 27653 heartbeater.cc:511] Master 127.12.159.254:45659 requested a full tablet report, sending...
I20260923 19:38:54.992769 27336 ts_manager.cc:194] Registered new tserver with Master: 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
I20260923 19:38:54.993587 27336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:45697
W20260923 19:38:55.301935 27656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:55.302210 27656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:55.302379 27656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:55.309571 27656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:55.309695 27656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:55.309893 27656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:38:55.320065 27656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:33411
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=35329
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:55.321461 27656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:55.322986 27656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:55.336117 27662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:55.336175 27661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:55.336066 27664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:55.336908 27656 server_base.cc:1034] running on GCE node
I20260923 19:38:55.337544 27656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:55.338563 27656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:55.339761 27656 hybrid_clock.cc:648] HybridClock initialized: now 1790192335339708 us; error 69 us; skew 500 ppm
I20260923 19:38:55.340073 27656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:55 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192335, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:55.343217 27656 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:38:55.344714 27656 webserver.cc:460] Webserver started at http://127.12.159.195:35329/ using document root <none> and password file <none>
I20260923 19:38:55.345431 27656 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:55.345592 27656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:55.350981 27656 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:38:55.353767 27671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:55.355207 27656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:38:55.355401 27656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "b67db278cb2340c8baa900f1689f39a9"
format_stamp: "Formatted at 2026-09-23 19:38:52 on dist-test-slave-lzv7"
server_key: "f562372fcf526acd56710d47d76236d8"
server_key_iv: "5f80aa6e4851bf2f5e2b7de99677a8f0"
server_key_version: "encryptionkey@0"
I20260923 19:38:55.356433 27656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:55.370309 27656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:55.374291 27656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:55.374569 27656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:55.375509 27656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:55.376809 27656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:55.376941 27656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:55.377069 27656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:55.377157 27656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:55.413447 27656 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:33411
I20260923 19:38:55.413535 27783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:33411 every 8 connection(s)
I20260923 19:38:55.415007 27656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:38:55.425271 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 27656
Sep 23 19:38:55 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192335, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:38:55.438277 27523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.417867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:59361 (local address 127.12.159.254:45659)
0923 19:38:55.418098 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.418104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.419519 (+ 1415us) server_negotiation.cc:407] Connection header received
0923 19:38:55.421630 (+ 2111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.421635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.421727 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.421886 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:55.423590 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.424383 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.426544 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.427283 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.427416 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.431349 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:55.431353 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:55.431357 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:55.431389 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:55.434692 (+ 3303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.435659 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.435662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.435665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.435780 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.436238 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.436244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.436256 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.436668 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:55.436786 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.437573 (+ 787us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.437848 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:38:55.439275 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.418341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:59361)
0923 19:38:55.419353 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.419400 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:55.421334 (+ 1934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:55.422133 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:55.422142 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:55.422753 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:55.423390 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.423408 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.424570 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.424574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.426395 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.426408 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.427513 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.427522 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.427780 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.428491 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:55.428513 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:55.431123 (+ 2610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:55.434839 (+ 3716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:55.434850 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:55.434871 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:55.435532 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:55.435891 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:55.435896 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:55.435902 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:55.436114 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:55.436808 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:55.436818 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:55.437193 (+ 375us) client_negotiation.cc:769] Sending connection context
0923 19:38:55.437424 (+ 231us) client_negotiation.cc:240] Negotiation successful
0923 19:38:55.438010 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":428,"threads_started":1}
I20260923 19:38:55.441136 27784 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45659
I20260923 19:38:55.441510 27784 heartbeater.cc:464] Registering TS with master...
I20260923 19:38:55.441998 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.426341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47106 (local address 127.12.159.254:45659)
0923 19:38:55.427278 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.427282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.427298 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:38:55.427339 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.427343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.427397 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.427544 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:55.429058 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.430060 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.431916 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.432653 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.432794 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.435981 (+ 3187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:55.435984 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:55.435987 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:55.436014 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:55.438989 (+ 2975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.439857 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.439865 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.439871 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.440047 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.440423 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.440428 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.440431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.440829 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:55.441093 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.441432 (+ 339us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.441624 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":847,"thread_start_us":703,"threads_started":1}
I20260923 19:38:55.442550 27784 heartbeater.cc:511] Master 127.12.159.254:45659 requested a full tablet report, sending...
I20260923 19:38:55.444293 27335 ts_manager.cc:194] Registered new tserver with Master: b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411)
I20260923 19:38:55.445188 27335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:59361
I20260923 19:38:55.456965 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:38:55.464183 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.457913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.12.159.254:45659)
0923 19:38:55.458147 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.458157 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.458562 (+ 405us) server_negotiation.cc:407] Connection header received
0923 19:38:55.458759 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.458763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.458901 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.459023 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:38:55.459419 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.460118 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.461880 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.462340 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.462432 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.462983 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:38:55.463534 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:38:55.463718 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.463779 (+ 61us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.463859 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:38:55.465099 27335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:38:55.472464 27335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:38:55.505153 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.486607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60924 (local address 127.12.159.195:33411)
0923 19:38:55.494138 (+ 7531us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.494149 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.494190 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:38:55.494319 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.494331 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.494648 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.495916 (+ 1268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:55.497557 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.499718 (+ 2161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.502890 (+ 3172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.503959 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.504167 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.504353 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.504651 (+ 298us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.504819 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7315,"thread_start_us":7143,"threads_started":1}
I20260923 19:38:55.505275 27794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.485913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33411 (local address 127.0.0.1:60924)
0923 19:38:55.491771 (+ 5858us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.491826 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:55.492068 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:55.494961 (+ 2893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:55.494972 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:55.495015 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:55.495617 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.495635 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.499962 (+ 4327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.499971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.502698 (+ 2727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.502727 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.504164 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.504170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.504389 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.504444 (+ 55us) client_negotiation.cc:769] Sending connection context
0923 19:38:55.504588 (+ 144us) client_negotiation.cc:240] Negotiation successful
0923 19:38:55.504779 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5525,"mutex_wait_us":72,"thread_start_us":5348,"threads_started":1}
I20260923 19:38:55.505976 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.486537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.12.159.193:36033)
0923 19:38:55.493409 (+ 6872us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.493421 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.493462 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:38:55.494353 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.494366 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.494674 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.494888 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:55.496154 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.498216 (+ 2062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.503002 (+ 4786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.504474 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.504655 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.504820 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.505467 (+ 647us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.505639 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6697,"thread_start_us":6683,"threads_started":1}
I20260923 19:38:55.506754 27795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.486046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36000)
0923 19:38:55.492785 (+ 6739us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.492807 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:55.492940 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:55.495347 (+ 2407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:55.495355 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:55.495396 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:55.495936 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.495951 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.498464 (+ 2513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.498472 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.502844 (+ 4372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.502858 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.505007 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.505012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.505250 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.505295 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 19:38:55.506240 (+ 945us) client_negotiation.cc:240] Negotiation successful
0923 19:38:55.506374 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6563,"mutex_wait_us":76,"thread_start_us":6390,"threads_started":1}
I20260923 19:38:55.509438 27719 tablet_service.cc:1467] Processing CreateTablet for tablet 089ae0980c33453fa374693cb01bc98d (DEFAULT_TABLE table=test-table [id=2f446b51ab7142b0ada624b5cae04ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:55.510044 27456 tablet_service.cc:1467] Processing CreateTablet for tablet 089ae0980c33453fa374693cb01bc98d (DEFAULT_TABLE table=test-table [id=2f446b51ab7142b0ada624b5cae04ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:55.510831 27719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089ae0980c33453fa374693cb01bc98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:55.511466 27456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089ae0980c33453fa374693cb01bc98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:55.511871 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.493077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43283 (local address 127.0.0.1:51626)
0923 19:38:55.501623 (+ 8546us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.501640 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:55.501755 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:55.502465 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:55.502470 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:55.502500 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:55.503052 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.503066 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.504945 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.504953 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.507108 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.507119 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.511041 (+ 3922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.511047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.511219 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.511264 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 19:38:55.511369 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:38:55.511501 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8369,"mutex_wait_us":25,"thread_start_us":8219,"threads_started":1}
I20260923 19:38:55.511940 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.493367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51626 (local address 127.12.159.194:43283)
0923 19:38:55.501836 (+ 8469us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.501845 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.501874 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:38:55.501983 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.501992 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.502259 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.502484 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:55.503239 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.504781 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.507266 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.510788 (+ 3522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.510959 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.511137 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.511437 (+ 300us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.511611 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8279,"thread_start_us":7552,"threads_started":1}
I20260923 19:38:55.517465 27588 tablet_service.cc:1467] Processing CreateTablet for tablet 089ae0980c33453fa374693cb01bc98d (DEFAULT_TABLE table=test-table [id=2f446b51ab7142b0ada624b5cae04ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:38:55.518935 27588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089ae0980c33453fa374693cb01bc98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:38:55.524264 27521 heartbeater.cc:503] Master 127.12.159.254:45659 was elected leader, sending a full tablet report...
I20260923 19:38:55.526460 27800 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Bootstrap starting.
I20260923 19:38:55.528844 27801 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Bootstrap starting.
I20260923 19:38:55.530247 27800 tablet_bootstrap.cc:654] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:55.531574 27800 log.cc:824] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:55.532588 27801 tablet_bootstrap.cc:654] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:55.533876 27801 log.cc:824] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:55.534049 27803 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Bootstrap starting.
I20260923 19:38:55.534801 27800 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: No bootstrap required, opened a new log
I20260923 19:38:55.535084 27800 ts_tablet_manager.cc:1397] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:38:55.537501 27803 tablet_bootstrap.cc:654] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Neither blocks nor log segments found. Creating new log.
I20260923 19:38:55.538280 27801 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: No bootstrap required, opened a new log
I20260923 19:38:55.538558 27801 ts_tablet_manager.cc:1397] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260923 19:38:55.538736 27803 log.cc:824] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:55.541724 27803 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: No bootstrap required, opened a new log
I20260923 19:38:55.542138 27803 ts_tablet_manager.cc:1397] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260923 19:38:55.543121 27800 raft_consensus.cc:348] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.543499 27800 raft_consensus.cc:374] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:55.543622 27800 raft_consensus.cc:729] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63216c2973a4513ba54ccccfbfb38df, State: Initialized, Role: FOLLOWER
I20260923 19:38:55.544235 27800 consensus_queue.cc:260] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.546088 27800 ts_tablet_manager.cc:1428] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260923 19:38:55.549240 27801 raft_consensus.cc:348] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.549695 27801 raft_consensus.cc:374] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:55.549789 27801 raft_consensus.cc:729] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67db278cb2340c8baa900f1689f39a9, State: Initialized, Role: FOLLOWER
I20260923 19:38:55.550446 27801 consensus_queue.cc:260] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.551452 27784 heartbeater.cc:503] Master 127.12.159.254:45659 was elected leader, sending a full tablet report...
I20260923 19:38:55.552168 27801 ts_tablet_manager.cc:1428] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260923 19:38:55.552508 27803 raft_consensus.cc:348] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.552969 27803 raft_consensus.cc:374] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:38:55.553071 27803 raft_consensus.cc:729] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2143c5bd2827443eaefb16a3fa373ffc, State: Initialized, Role: FOLLOWER
I20260923 19:38:55.553578 27803 consensus_queue.cc:260] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.554719 27653 heartbeater.cc:503] Master 127.12.159.254:45659 was elected leader, sending a full tablet report...
I20260923 19:38:55.555219 27803 ts_tablet_manager.cc:1428] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260923 19:38:55.559540 27806 raft_consensus.cc:482] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:38:55.559832 27806 raft_consensus.cc:504] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.561486 27806 leader_election.cc:288] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
I20260923 19:38:55.568269 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.562062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:32829 (local address 127.12.159.194:43283)
0923 19:38:55.562276 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.562285 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.562948 (+ 663us) server_negotiation.cc:407] Connection header received
0923 19:38:55.563113 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.563117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.563168 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.563264 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:55.563830 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.564756 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.566574 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.567341 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.567514 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.567611 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.567873 (+ 262us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.568003 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:38:55.568372 27810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.562041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43283 (local address 127.12.159.193:32829)
0923 19:38:55.562857 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.562871 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:55.562973 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:55.563289 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:55.563294 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:55.563325 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:55.563667 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.563679 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.564876 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.564883 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.566430 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.566442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.567543 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.567549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.567720 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.567744 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 19:38:55.567859 (+ 115us) client_negotiation.cc:240] Negotiation successful
0923 19:38:55.567993 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":506,"threads_started":1}
I20260923 19:38:55.568437 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.561722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:48029 (local address 127.12.159.195:33411)
0923 19:38:55.561974 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.561981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.562826 (+ 845us) server_negotiation.cc:407] Connection header received
0923 19:38:55.563079 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.563086 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.563165 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.563261 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:38:55.564139 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.565015 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.566758 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.567526 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.567715 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.567799 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.568063 (+ 264us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.568191 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260923 19:38:55.568506 27809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.561699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33411 (local address 127.12.159.193:48029)
0923 19:38:55.562716 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.562732 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:55.562905 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:55.563566 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:55.563570 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:55.563599 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:38:55.564002 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.564011 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.565151 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.565156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.566605 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:55.566616 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.567743 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.567749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:55.567913 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.567937 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 19:38:55.568039 (+ 102us) client_negotiation.cc:240] Negotiation successful
0923 19:38:55.568165 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"thread_start_us":676,"threads_started":1}
I20260923 19:38:55.569656 27608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089ae0980c33453fa374693cb01bc98d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2143c5bd2827443eaefb16a3fa373ffc" is_pre_election: true
I20260923 19:38:55.569654 27739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089ae0980c33453fa374693cb01bc98d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67db278cb2340c8baa900f1689f39a9" is_pre_election: true
I20260923 19:38:55.570262 27608 raft_consensus.cc:2454] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 0.
I20260923 19:38:55.570262 27739 raft_consensus.cc:2454] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 0.
I20260923 19:38:55.571009 27410 leader_election.cc:302] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2143c5bd2827443eaefb16a3fa373ffc, d63216c2973a4513ba54ccccfbfb38df; no voters:
I20260923 19:38:55.571465 27806 raft_consensus.cc:2781] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:38:55.571622 27806 raft_consensus.cc:482] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:38:55.571733 27806 raft_consensus.cc:3037] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:55.573930 27806 raft_consensus.cc:504] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.574487 27806 leader_election.cc:288] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 election: Requested vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
I20260923 19:38:55.574913 27739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089ae0980c33453fa374693cb01bc98d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67db278cb2340c8baa900f1689f39a9"
I20260923 19:38:55.574975 27608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089ae0980c33453fa374693cb01bc98d" candidate_uuid: "d63216c2973a4513ba54ccccfbfb38df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2143c5bd2827443eaefb16a3fa373ffc"
I20260923 19:38:55.575099 27739 raft_consensus.cc:3037] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:55.575204 27608 raft_consensus.cc:3037] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:38:55.577378 27739 raft_consensus.cc:2454] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 1.
I20260923 19:38:55.577406 27608 raft_consensus.cc:2454] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63216c2973a4513ba54ccccfbfb38df in term 1.
I20260923 19:38:55.577768 27409 leader_election.cc:302] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67db278cb2340c8baa900f1689f39a9, d63216c2973a4513ba54ccccfbfb38df; no voters:
I20260923 19:38:55.578151 27806 raft_consensus.cc:2781] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:38:55.578580 27806 raft_consensus.cc:686] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 LEADER]: Becoming Leader. State: Replica: d63216c2973a4513ba54ccccfbfb38df, State: Running, Role: LEADER
I20260923 19:38:55.579113 27806 consensus_queue.cc:237] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:55.583742 27336 catalog_manager.cc:5495] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df reported cstate change: term changed from 0 to 1, leader changed from <none> to d63216c2973a4513ba54ccccfbfb38df (127.12.159.193). New cstate: current_term: 1 leader_uuid: "d63216c2973a4513ba54ccccfbfb38df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } health_report { overall_health: UNKNOWN } } }
I20260923 19:38:55.619771 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.614297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36006 (local address 127.12.159.193:36033)
0923 19:38:55.614486 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.614490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.614508 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:38:55.614673 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.614677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.614777 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.614900 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:38:55.615208 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.615906 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.617435 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.617851 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.617939 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.618564 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:38:55.619119 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:38:55.619225 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.619393 (+ 168us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.619484 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:38:55.628585 27608 raft_consensus.cc:1261] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Refusing update from remote peer d63216c2973a4513ba54ccccfbfb38df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:55.628696 27739 raft_consensus.cc:1261] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Refusing update from remote peer d63216c2973a4513ba54ccccfbfb38df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:38:55.629609 27811 consensus_queue.cc:1035] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [LEADER]: Connected to new peer: Peer: permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:55.630024 27806 consensus_queue.cc:1035] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:38:55.642484 27813 mvcc.cc:205] Tried to move back new op lower bound from 7332627806724141056 to 7332627806535872512. Current Snapshot: MvccSnapshot[applied={T|T < 7332627806724141056}]
I20260923 19:38:55.646565 27814 mvcc.cc:205] Tried to move back new op lower bound from 7332627806724141056 to 7332627806535872512. Current Snapshot: MvccSnapshot[applied={T|T < 7332627806724141056}]
I20260923 19:38:55.660614 27335 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:38:55.660935 27335 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:38:55.664482 27335 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Sending DeleteTablet for 3 replicas of tablet 089ae0980c33453fa374693cb01bc98d
I20260923 19:38:55.665824 27719 tablet_service.cc:1514] Processing DeleteTablet for tablet 089ae0980c33453fa374693cb01bc98d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:55 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:60924
I20260923 19:38:55.666255 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 27373
I20260923 19:38:55.666428 27588 tablet_service.cc:1514] Processing DeleteTablet for tablet 089ae0980c33453fa374693cb01bc98d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:55 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51626
I20260923 19:38:55.665648 27456 tablet_service.cc:1514] Processing DeleteTablet for tablet 089ae0980c33453fa374693cb01bc98d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:38:55 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:36000
I20260923 19:38:55.681918 27824 tablet_replica.cc:330] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: stopping tablet replica
I20260923 19:38:55.682803 27824 raft_consensus.cc:2229] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:38:55.683624 27824 raft_consensus.cc:2258] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:55.686460 27824 ts_tablet_manager.cc:1905] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:55.690363 27823 tablet_replica.cc:330] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: stopping tablet replica
I20260923 19:38:55.690864 27823 raft_consensus.cc:2229] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:38:55.691448 27823 raft_consensus.cc:2258] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:55.693114 27825 tablet_replica.cc:330] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: stopping tablet replica
I20260923 19:38:55.694022 27824 ts_tablet_manager.cc:1918] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:55.694253 27824 log.cc:1196] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/089ae0980c33453fa374693cb01bc98d
I20260923 19:38:55.695026 27824 ts_tablet_manager.cc:1939] T 089ae0980c33453fa374693cb01bc98d P 2143c5bd2827443eaefb16a3fa373ffc: Deleting consensus metadata
I20260923 19:38:55.694240 27825 raft_consensus.cc:2229] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:38:55.695760 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.668241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36012 (local address 127.12.159.193:36033)
0923 19:38:55.668451 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.668460 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.668484 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:38:55.668560 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.668568 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.668670 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.668790 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:55.671388 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.673015 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.675914 (+ 2899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.676946 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.677105 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.684679 (+ 7574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:55.684702 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:55.684728 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:55.684806 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:55.691771 (+ 6965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.692975 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.692986 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.692990 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.693212 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.693700 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.693706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.693710 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.694301 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:55.694615 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.695000 (+ 385us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.695275 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:38:55.696534 27825 raft_consensus.cc:2258] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:38:55.697222 27321 catalog_manager.cc:4841] TS 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283): tablet 089ae0980c33453fa374693cb01bc98d (table test-table [id=2f446b51ab7142b0ada624b5cae04ff0]) successfully deleted
I20260923 19:38:55.696830 27516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:55.699102 27823 ts_tablet_manager.cc:1905] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:38:55.706858 27823 ts_tablet_manager.cc:1918] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:38:55.707052 27823 log.cc:1196] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/089ae0980c33453fa374693cb01bc98d
I20260923 19:38:55.707633 27823 ts_tablet_manager.cc:1939] T 089ae0980c33453fa374693cb01bc98d P b67db278cb2340c8baa900f1689f39a9: Deleting consensus metadata
I20260923 19:38:55.709700 27320 catalog_manager.cc:4841] TS b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411): tablet 089ae0980c33453fa374693cb01bc98d (table test-table [id=2f446b51ab7142b0ada624b5cae04ff0]) successfully deleted
I20260923 19:38:55.796772 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 27373
I20260923 19:38:55.814900 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 27525
W20260923 19:38:55.815186 27321 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.159.193:36033 (error 108)
I20260923 19:38:55.817094 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.816692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36028)
0923 19:38:55.816860 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.816962 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 19:38:55.817329 27321 catalog_manager.cc:4584] TS d63216c2973a4513ba54ccccfbfb38df (127.12.159.193:36033): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 089ae0980c33453fa374693cb01bc98d: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
I20260923 19:38:55.829360 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.815816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51636 (local address 127.12.159.194:43283)
0923 19:38:55.816000 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.816005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.816087 (+ 82us) server_negotiation.cc:407] Connection header received
0923 19:38:55.816331 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.816336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.816460 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.816581 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:55.818148 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.818944 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.820212 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.820619 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.820757 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.823686 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:55.823699 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:55.823714 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:55.823744 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:55.826557 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.827247 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.827257 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.827263 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.827389 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.827783 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.827790 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.827793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.828172 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:55.828472 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.828780 (+ 308us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.829002 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:38:55.830111 27648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:55.871006 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.870463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36032)
0923 19:38:55.870697 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.870836 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260923 19:38:55.872049 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.871740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36042)
0923 19:38:55.871869 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.871949 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260923 19:38:55.922495 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 27525
I20260923 19:38:55.932976 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.932407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36044)
0923 19:38:55.932684 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.932781 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 19:38:55.934005 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.933667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36050)
0923 19:38:55.933833 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:55.933905 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 19:38:55.943336 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 27656
I20260923 19:38:55.957388 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:55.944159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60930 (local address 127.12.159.195:33411)
0923 19:38:55.944353 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:55.944358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:55.944401 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:38:55.944552 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:55.944556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:55.944630 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:55.944719 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:55.946135 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.946875 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.948185 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:55.948597 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:55.948734 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:55.951614 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:55.951629 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:55.951645 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:55.951677 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:55.954634 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.955327 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.955336 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.955340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.955495 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:55.955851 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:55.955855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:55.955859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:55.956306 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:55.956602 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:55.956831 (+ 229us) server_negotiation.cc:299] Negotiation successful
0923 19:38:55.957045 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:38:55.958118 27779 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:56.014389 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:56.013797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36062)
0923 19:38:56.014082 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:56.014195 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260923 19:38:56.015450 27798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:56.015025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:36033 (local address 127.0.0.1:36074)
0923 19:38:56.015237 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:56.015321 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:36033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260923 19:38:56.047902 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 27656
I20260923 19:38:56.064360 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 27303
I20260923 19:38:56.065521 27366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:38:56.180743 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 27303
I20260923 19:38:56.202600 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45659
--webserver_interface=127.12.159.254
--webserver_port=33201
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45659
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:56.537006 27831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:56.537286 27831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:56.537375 27831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:56.544718 27831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:38:56.544826 27831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:56.544872 27831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:56.544930 27831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:38:56.544974 27831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:38:56.554904 27831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=33201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:56.556178 27831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:56.557384 27831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:56.569432 27839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:56.569681 27837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:56.569471 27836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:56.570271 27831 server_base.cc:1034] running on GCE node
I20260923 19:38:56.571146 27831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:56.572634 27831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:56.573913 27831 hybrid_clock.cc:648] HybridClock initialized: now 1790192336573844 us; error 58 us; skew 500 ppm
I20260923 19:38:56.574272 27831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:56 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192336, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:56.577500 27831 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:38:56.579161 27831 webserver.cc:460] Webserver started at http://127.12.159.254:33201/ using document root <none> and password file <none>
I20260923 19:38:56.579872 27831 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:56.580024 27831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:56.585425 27831 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:38:56.588265 27846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:56.589663 27831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:38:56.589999 27831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "a71e0aa99bd646cc85ab381e1bfe2d34"
format_stamp: "Formatted at 2026-09-23 19:38:50 on dist-test-slave-lzv7"
server_key: "09fdbe822f552030f059ca78d3cb6d5c"
server_key_iv: "dc9c57d818c6bd59e0f92d18f7fcabc8"
server_key_version: "encryptionkey@0"
I20260923 19:38:56.590950 27831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:56.619163 27831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:56.623688 27831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:56.623978 27831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:56.642614 27831 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45659
I20260923 19:38:56.642633 27897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45659 every 8 connection(s)
I20260923 19:38:56.644191 27831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:38:56.645009 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 27831
I20260923 19:38:56.646016 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:36033
--local_ip_for_outbound_sockets=127.12.159.193
--tserver_master_addrs=127.12.159.254:45659
--webserver_port=39247
--webserver_interface=127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:38:56.651485 27898 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:38:56.660051 27898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Bootstrap starting.
I20260923 19:38:56.690508 27898 log.cc:824] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:56.712507 27898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:38:56.713359 27898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34: Bootstrap complete.
I20260923 19:38:56.727306 27898 raft_consensus.cc:348] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:56.728544 27898 raft_consensus.cc:729] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a71e0aa99bd646cc85ab381e1bfe2d34, State: Initialized, Role: FOLLOWER
I20260923 19:38:56.729261 27898 consensus_queue.cc:260] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:56.729532 27898 raft_consensus.cc:388] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:38:56.729663 27898 raft_consensus.cc:482] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:38:56.729889 27898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:38:56.735476 27898 raft_consensus.cc:504] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:56.736075 27898 leader_election.cc:302] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a71e0aa99bd646cc85ab381e1bfe2d34; no voters:
I20260923 19:38:56.736785 27898 leader_election.cc:288] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 19:38:56.736937 27902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 19:38:56.738323 27902 raft_consensus.cc:686] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [term 3 LEADER]: Becoming Leader. State: Replica: a71e0aa99bd646cc85ab381e1bfe2d34, State: Running, Role: LEADER
I20260923 19:38:56.738878 27902 consensus_queue.cc:237] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } }
I20260923 19:38:56.739039 27898 sys_catalog.cc:564] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:38:56.741328 27904 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a71e0aa99bd646cc85ab381e1bfe2d34. Latest consensus state: current_term: 3 leader_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } } }
I20260923 19:38:56.741714 27904 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:56.742290 27903 sys_catalog.cc:455] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a71e0aa99bd646cc85ab381e1bfe2d34" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45659 } } }
I20260923 19:38:56.742592 27903 sys_catalog.cc:458] T 00000000000000000000000000000000 P a71e0aa99bd646cc85ab381e1bfe2d34 [sys.catalog]: This master's current role is: LEADER
I20260923 19:38:56.755348 27908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:38:56.766983 27908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:38:56.769394 27908 catalog_manager.cc:1259] Loaded cluster ID: 5311c514bf4448e982a8b9343e64305f
I20260923 19:38:56.769519 27908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260923 19:38:56.772156 27908 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f28e3ada9ad google::LogMessage::Fail() at ??:0
@ 0x7f28e3add88a google::LogMessage::SendToLog() at ??:0
@ 0x7f28e3ada4de google::LogMessage::Flush() at ??:0
@ 0x7f28e3adba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260923 19:38:56.787937 27920 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f28f950d512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f28f950a976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f28f9592610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f28f9592439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f28e6726345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f28e672991c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f28e6729799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f28e6704eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f28e99de6db start_thread at ??:0
@ 0x7f28e297461f clone at ??:0
W20260923 19:38:57.089237 27900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:57.089519 27900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:57.089681 27900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:57.097067 27900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:57.097179 27900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:57.097344 27900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:38:57.107295 27900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:36033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=39247
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:57.108623 27900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:57.110008 27900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:57.123818 27939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:57.123865 27942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:57.123919 27940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:57.130196 27900 server_base.cc:1034] running on GCE node
I20260923 19:38:57.130885 27900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:57.131908 27900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:57.133118 27900 hybrid_clock.cc:648] HybridClock initialized: now 1790192337133049 us; error 62 us; skew 500 ppm
I20260923 19:38:57.133450 27900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:57 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192337, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:57.136652 27900 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:38:57.138258 27900 webserver.cc:460] Webserver started at http://127.12.159.193:39247/ using document root <none> and password file <none>
I20260923 19:38:57.138980 27900 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:57.139108 27900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:57.144439 27900 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260923 19:38:57.147444 27949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:57.148830 27900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:38:57.149011 27900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "d63216c2973a4513ba54ccccfbfb38df"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "c0b4a5e9b82b46cdfcdcb4b1bf2be2fa"
server_key_iv: "fc0b9b87c8250ee54e75e7b2c0a9b7aa"
server_key_version: "encryptionkey@0"
I20260923 19:38:57.150064 27900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:57.173755 27900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:57.177779 27900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:57.178125 27900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:57.179128 27900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:57.180995 27956 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260923 19:38:57.186923 27900 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 19:38:57.187076 27900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260923 19:38:57.187234 27900 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 19:38:57.190456 27900 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 19:38:57.190568 27900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:57.190966 27956 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Bootstrap starting.
I20260923 19:38:57.199929 27956 log.cc:824] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Log is configured to *not* fsync() on all Append() calls
I20260923 19:38:57.216040 27956 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:38:57.216954 27956 tablet_bootstrap.cc:492] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Bootstrap complete.
I20260923 19:38:57.217660 27956 ts_tablet_manager.cc:1397] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.009s
I20260923 19:38:57.228293 27956 raft_consensus.cc:348] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:57.229557 27956 raft_consensus.cc:729] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63216c2973a4513ba54ccccfbfb38df, State: Initialized, Role: FOLLOWER
I20260923 19:38:57.229789 27900 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:36033
I20260923 19:38:57.229846 28063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:36033 every 8 connection(s)
I20260923 19:38:57.230458 27956 consensus_queue.cc:260] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:57.231093 27900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:38:57.232441 27956 ts_tablet_manager.cc:1428] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df: Time spent starting tablet: real 0.015s user 0.012s sys 0.003s
I20260923 19:38:57.234933 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 27900
I20260923 19:38:57.235558 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:43283
--local_ip_for_outbound_sockets=127.12.159.194
--tserver_master_addrs=127.12.159.254:45659
--webserver_port=44735
--webserver_interface=127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:38:57.235834 28067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:57.233893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:46677)
0923 19:38:57.234627 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:57.234873 (+ 246us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":349,"threads_started":1}
W20260923 19:38:57.236531 28065 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:45659 (0 consecutive failures): Network error: Failed to ping master at 127.12.159.254:45659: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
I20260923 19:38:57.237334 28067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:57.237015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:45197)
0923 19:38:57.237157 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:57.237239 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260923 19:38:57.238325 28067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:57.237876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:34801)
0923 19:38:57.238059 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:57.238156 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:38:57.238579 28065 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 19:38:57.566090 28068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:57.566509 28068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:57.566701 28068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:57.573920 28068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:57.574070 28068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:57.574270 28068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:38:57.584131 28068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:43283
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=44735
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:57.585716 28068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:57.587298 28068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:57.601059 28076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:57.601117 28073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:57.601153 28074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:57.602368 28068 server_base.cc:1034] running on GCE node
I20260923 19:38:57.603005 28068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:57.604036 28068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:57.605283 28068 hybrid_clock.cc:648] HybridClock initialized: now 1790192337605212 us; error 65 us; skew 500 ppm
I20260923 19:38:57.605589 28068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:57 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192337, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:57.608709 28068 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:38:57.610139 28068 webserver.cc:460] Webserver started at http://127.12.159.194:44735/ using document root <none> and password file <none>
I20260923 19:38:57.610800 28068 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:57.610900 28068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:57.616207 28068 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 19:38:57.618901 28083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:57.620222 28068 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:57.620415 28068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "2143c5bd2827443eaefb16a3fa373ffc"
format_stamp: "Formatted at 2026-09-23 19:38:51 on dist-test-slave-lzv7"
server_key: "eb53ad328c1c2f405d7a8d891680d4d1"
server_key_iv: "72744ab049b2fa0a94de6ea2d76f3f62"
server_key_version: "encryptionkey@0"
I20260923 19:38:57.621394 28068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:57.639932 28068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:57.644505 28068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:57.644800 28068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:57.645929 28068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:57.647367 28068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:57.647450 28068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:57.647619 28068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:57.647696 28068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:57.679476 28068 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:43283
I20260923 19:38:57.679533 28195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:43283 every 8 connection(s)
I20260923 19:38:57.680989 28068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:38:57.685703 28198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:57.683923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:34529)
0923 19:38:57.684620 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:57.684834 (+ 214us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":262,"threads_started":1}
W20260923 19:38:57.686388 28196 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:45659 (0 consecutive failures): Network error: Failed to ping master at 127.12.159.254:45659: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
I20260923 19:38:57.687220 28198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:57.686892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:53301)
0923 19:38:57.687043 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:57.687123 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 19:38:57.688042 28198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:57.687701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:39235)
0923 19:38:57.687862 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:57.687940 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260923 19:38:57.688319 28196 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:38:57.688642 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 28068
I20260923 19:38:57.689193 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:33411
--local_ip_for_outbound_sockets=127.12.159.195
--tserver_master_addrs=127.12.159.254:45659
--webserver_port=35329
--webserver_interface=127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:43141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:38:58.018050 28199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:38:58.018334 28199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:38:58.018496 28199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:38:58.025774 28199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:38:58.025954 28199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:38:58.026134 28199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:38:58.036068 28199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:43141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:33411
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=35329
--tserver_master_addrs=127.12.159.254:45659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:38:58.037386 28199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:38:58.038726 28199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:38:58.054273 28207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:58.054229 28204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:38:58.054312 28205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:38:58.055253 28199 server_base.cc:1034] running on GCE node
I20260923 19:38:58.055877 28199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:38:58.056797 28199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:38:58.058050 28199 hybrid_clock.cc:648] HybridClock initialized: now 1790192338058008 us; error 51 us; skew 500 ppm
I20260923 19:38:58.058399 28199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:38:58 dist-test-slave-lzv7 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192338, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:38:58.061880 28199 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:38:58.063313 28199 webserver.cc:460] Webserver started at http://127.12.159.195:35329/ using document root <none> and password file <none>
I20260923 19:38:58.064013 28199 fs_manager.cc:359] Metadata directory not provided
I20260923 19:38:58.064160 28199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:38:58.069679 28199 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260923 19:38:58.072528 28214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:58.073946 28199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:38:58.074124 28199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "b67db278cb2340c8baa900f1689f39a9"
format_stamp: "Formatted at 2026-09-23 19:38:52 on dist-test-slave-lzv7"
server_key: "f562372fcf526acd56710d47d76236d8"
server_key_iv: "5f80aa6e4851bf2f5e2b7de99677a8f0"
server_key_version: "encryptionkey@0"
I20260923 19:38:58.075088 28199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:38:58.090801 28199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:38:58.095084 28199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:38:58.095367 28199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:38:58.096340 28199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:38:58.097615 28199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:38:58.097743 28199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:58.097889 28199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:38:58.097981 28199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:38:58.129211 28199 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:33411
I20260923 19:38:58.129269 28326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:33411 every 8 connection(s)
I20260923 19:38:58.130752 28199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:38:58.131727 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 28199
I20260923 19:38:58.135705 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.133889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:41693)
0923 19:38:58.134581 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:58.134858 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":276,"threads_started":1}
W20260923 19:38:58.136421 28327 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:45659 (0 consecutive failures): Network error: Failed to ping master at 127.12.159.254:45659: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
I20260923 19:38:58.137282 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.136963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:56151)
0923 19:38:58.137101 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:58.137174 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 19:38:58.138168 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.137873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:33611)
0923 19:38:58.137992 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:58.138063 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260923 19:38:58.138391 28327 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:38:58.239786 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.239062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:56835)
0923 19:38:58.239492 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:58.239582 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":206,"threads_started":1}
I20260923 19:38:58.636914 28332 raft_consensus.cc:482] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:38:58.637252 28332 raft_consensus.cc:504] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:38:58.638979 28332 leader_election.cc:288] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
Sep 23 19:38:58 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192337, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
Sep 23 19:38:58 dist-test-slave-lzv7 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192337, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:38:58.662961 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.639285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:33411 (local address 127.12.159.193:36867)
0923 19:38:58.639548 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:58.639590 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:58.640272 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:58.643946 (+ 3674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:58.643956 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:58.644764 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:58.645502 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:58.645530 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.647354 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.647361 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:58.648824 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:58.648836 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.649854 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.649860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:58.650107 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:58.650821 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:58.650857 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:58.653574 (+ 2717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:58.658316 (+ 4742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:58.658325 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:58.658339 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:58.659071 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:58.659646 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:58.659652 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:58.659655 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:58.659917 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:58.660982 (+ 1065us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:58.660990 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:58.661486 (+ 496us) client_negotiation.cc:769] Sending connection context
0923 19:38:58.661866 (+ 380us) client_negotiation.cc:240] Negotiation successful
0923 19:38:58.662573 (+ 707us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":321,"spinlock_wait_cycles":16640}
I20260923 19:38:58.663151 28335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.639798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:36867 (local address 127.12.159.195:33411)
0923 19:38:58.641489 (+ 1691us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:58.641507 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:58.641547 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:38:58.643097 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:58.643105 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:58.643472 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:58.643817 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:58.645732 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.647146 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.648977 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.649620 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.649813 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:58.653904 (+ 4091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:58.653914 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:58.653928 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:58.653963 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:58.658135 (+ 4172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:58.659235 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:58.659246 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:58.659255 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:58.659506 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:58.660046 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:58.660052 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:58.660056 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:58.660812 (+ 756us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:58.661008 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:58.662143 (+ 1135us) server_negotiation.cc:299] Negotiation successful
0923 19:38:58.662671 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1520,"thread_start_us":1400,"threads_started":1}
I20260923 19:38:58.663170 28334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.639564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:60261 (local address 127.12.159.194:43283)
0923 19:38:58.641069 (+ 1505us) server_negotiation.cc:206] Beginning negotiation
0923 19:38:58.641088 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 19:38:58.641603 (+ 515us) server_negotiation.cc:407] Connection header received
0923 19:38:58.643253 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:38:58.643262 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:38:58.643637 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:38:58.643989 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:38:58.645729 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.647483 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.649120 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.649796 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.650083 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:58.653964 (+ 3881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:38:58.653972 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:38:58.653985 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:38:58.654024 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:38:58.658150 (+ 4126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:58.659237 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:58.659245 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:58.659255 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:58.659506 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:38:58.660046 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:38:58.660052 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:38:58.660056 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:38:58.660810 (+ 754us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:38:58.661008 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0923 19:38:58.662157 (+ 1149us) server_negotiation.cc:299] Negotiation successful
0923 19:38:58.662671 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1327,"thread_start_us":1216,"threads_started":1}
I20260923 19:38:58.662974 28333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.639343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43283 (local address 127.12.159.193:60261)
0923 19:38:58.641466 (+ 2123us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:58.641484 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:38:58.641616 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:38:58.643949 (+ 2333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:38:58.643957 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:38:58.644817 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:38:58.645502 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:58.645539 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.647700 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.647705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:58.648956 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:38:58.648969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:38:58.650077 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:38:58.650085 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:38:58.650275 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:38:58.650968 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:38:58.650984 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:38:58.653411 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:38:58.658480 (+ 5069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:58.658485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:58.658489 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:58.659071 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:58.659646 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:38:58.659652 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:38:58.659655 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:38:58.659917 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:38:58.660982 (+ 1065us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:38:58.660990 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:38:58.661486 (+ 496us) client_negotiation.cc:769] Sending connection context
0923 19:38:58.661866 (+ 380us) client_negotiation.cc:240] Negotiation successful
0923 19:38:58.662454 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1983,"mutex_wait_us":147,"spinlock_wait_cycles":43776,"thread_start_us":1789,"threads_started":1}
W20260923 19:38:58.666584 27950 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
W20260923 19:38:58.666889 27951 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
I20260923 19:38:58.667035 27951 leader_election.cc:302] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d63216c2973a4513ba54ccccfbfb38df; no voters: 2143c5bd2827443eaefb16a3fa373ffc, b67db278cb2340c8baa900f1689f39a9
I20260923 19:38:58.667505 28332 raft_consensus.cc:2726] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:38:58.689690 28336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:58.688840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:55149)
0923 19:38:58.689302 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:58.689465 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":216,"threads_started":1}
I20260923 19:38:59.139731 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:59.138911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:51825)
0923 19:38:59.139361 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:59.139498 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":212,"threads_started":1}
I20260923 19:38:59.241354 28338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:59.240697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:41125)
0923 19:38:59.241104 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:59.241181 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":209,"threads_started":1}
I20260923 19:38:59.691330 28339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:38:59.690641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:34301)
0923 19:38:59.691090 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0923 19:38:59.691175 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":238,"threads_started":1}
I20260923 19:39:00.141256 28340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:00.140603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:55171)
0923 19:39:00.141029 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:00.141107 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":239,"threads_started":1}
I20260923 19:39:00.242945 28341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:00.242224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:48407)
0923 19:39:00.242687 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:00.242771 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":233,"threads_started":1}
I20260923 19:39:00.490118 28342 raft_consensus.cc:482] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:39:00.490315 28342 raft_consensus.cc:504] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:39:00.490953 28342 leader_election.cc:288] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
W20260923 19:39:00.491967 27951 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
W20260923 19:39:00.492136 27950 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
I20260923 19:39:00.492272 27950 leader_election.cc:302] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d63216c2973a4513ba54ccccfbfb38df; no voters: 2143c5bd2827443eaefb16a3fa373ffc, b67db278cb2340c8baa900f1689f39a9
I20260923 19:39:00.492520 28342 raft_consensus.cc:2726] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:39:00.692993 28343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:00.692316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:38501)
0923 19:39:00.692748 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:00.692829 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":215,"threads_started":1}
I20260923 19:39:01.142920 28344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:01.142239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:52531)
0923 19:39:01.142675 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:01.142761 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":217,"threads_started":1}
I20260923 19:39:01.244555 28345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:01.243844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:33287)
0923 19:39:01.244303 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:01.244391 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":233,"threads_started":1}
I20260923 19:39:01.694761 28346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:01.694034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:55119)
0923 19:39:01.694488 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:01.694574 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":231,"threads_started":1}
I20260923 19:39:02.144502 28347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:02.143815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:48565)
0923 19:39:02.144240 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:02.144324 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":206,"threads_started":1}
I20260923 19:39:02.246714 28348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:02.245618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:41259)
0923 19:39:02.246306 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:02.246400 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":356,"threads_started":1}
I20260923 19:39:02.696885 28349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:02.695972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:44805)
0923 19:39:02.696571 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:02.696701 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":317,"threads_started":1}
I20260923 19:39:03.146274 28350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:03.145474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:59277)
0923 19:39:03.145956 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:03.146044 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":233,"threads_started":1}
I20260923 19:39:03.248319 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:03.247641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:47981)
0923 19:39:03.248063 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:03.248160 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":222,"threads_started":1}
I20260923 19:39:03.519026 28352 raft_consensus.cc:482] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:39:03.519279 28352 raft_consensus.cc:504] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:39:03.519997 28352 leader_election.cc:288] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
W20260923 19:39:03.520916 27950 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
W20260923 19:39:03.521113 27951 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
I20260923 19:39:03.521267 27951 leader_election.cc:302] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d63216c2973a4513ba54ccccfbfb38df; no voters: 2143c5bd2827443eaefb16a3fa373ffc, b67db278cb2340c8baa900f1689f39a9
I20260923 19:39:03.521540 28352 raft_consensus.cc:2726] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:39:03.698791 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:03.697944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:52889)
0923 19:39:03.698512 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:03.698598 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":329,"threads_started":1}
I20260923 19:39:04.147886 28354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:04.147161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:60079)
0923 19:39:04.147607 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:04.147713 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":217,"threads_started":1}
I20260923 19:39:04.250341 28355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:04.249232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:35871)
0923 19:39:04.249718 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:04.250105 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":247,"threads_started":1}
I20260923 19:39:04.700837 28356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:04.699955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:34593)
0923 19:39:04.700543 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:04.700647 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":266,"threads_started":1}
I20260923 19:39:05.149562 28357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:05.148818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:42297)
0923 19:39:05.149298 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:05.149381 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":216,"threads_started":1}
I20260923 19:39:05.251965 28358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:05.251248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:45367)
0923 19:39:05.251706 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:05.251787 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":212,"threads_started":1}
I20260923 19:39:05.702723 28359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:05.701928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:50247)
0923 19:39:05.702412 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:05.702504 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":242,"threads_started":1}
I20260923 19:39:06.125550 28360 raft_consensus.cc:482] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:39:06.125782 28360 raft_consensus.cc:504] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d63216c2973a4513ba54ccccfbfb38df" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 36033 } } peers { permanent_uuid: "b67db278cb2340c8baa900f1689f39a9" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 33411 } } peers { permanent_uuid: "2143c5bd2827443eaefb16a3fa373ffc" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43283 } }
I20260923 19:39:06.126502 28360 leader_election.cc:288] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411), 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283)
W20260923 19:39:06.127395 27950 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b67db278cb2340c8baa900f1689f39a9 (127.12.159.195:33411): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
W20260923 19:39:06.127578 27951 leader_election.cc:341] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2143c5bd2827443eaefb16a3fa373ffc (127.12.159.194:43283): Not found: Tablet not found: 089ae0980c33453fa374693cb01bc98d
I20260923 19:39:06.127749 27951 leader_election.cc:302] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d63216c2973a4513ba54ccccfbfb38df; no voters: 2143c5bd2827443eaefb16a3fa373ffc, b67db278cb2340c8baa900f1689f39a9
I20260923 19:39:06.128012 28360 raft_consensus.cc:2726] T 089ae0980c33453fa374693cb01bc98d P d63216c2973a4513ba54ccccfbfb38df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:39:06.151155 28361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:06.150473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:40325)
0923 19:39:06.150890 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:06.150972 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":229,"threads_started":1}
I20260923 19:39:06.253877 28362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:06.252837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:47523)
0923 19:39:06.253363 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:06.253558 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":234,"threads_started":1}
I20260923 19:39:06.704365 28363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:06.703653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:47499)
0923 19:39:06.704110 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:06.704207 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":215,"threads_started":1}
I20260923 19:39:07.152868 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:07.152081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:39501)
0923 19:39:07.152610 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:07.152705 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":248,"threads_started":1}
I20260923 19:39:07.255628 28365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:07.254924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:37919)
0923 19:39:07.255370 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:07.255464 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":233,"threads_started":1}
I20260923 19:39:07.706200 28366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:07.705397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:60345)
0923 19:39:07.705916 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:07.706007 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":251,"threads_started":1}
I20260923 19:39:08.154837 28367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:08.154019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:41959)
0923 19:39:08.154507 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:08.154599 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":262,"threads_started":1}
I20260923 19:39:08.257246 28368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:08.256533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:59941)
0923 19:39:08.256979 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:08.257066 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":239,"threads_started":1}
I20260923 19:39:08.708168 28369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:08.707207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:47273)
0923 19:39:08.707832 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:08.707945 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":272,"threads_started":1}
I20260923 19:39:09.156488 28370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:09.155781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:46155)
0923 19:39:09.156235 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:09.156327 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":217,"threads_started":1}
I20260923 19:39:09.259016 28371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:09.258327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:34963)
0923 19:39:09.258759 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:09.258849 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":230,"threads_started":1}
I20260923 19:39:09.709753 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:09.709060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:38621)
0923 19:39:09.709497 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:09.709575 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":224,"threads_started":1}
I20260923 19:39:10.158501 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:10.157570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:39025)
0923 19:39:10.158164 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:10.158283 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":344,"threads_started":1}
I20260923 19:39:10.260749 28374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:10.260010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:53215)
0923 19:39:10.260450 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:10.260549 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":228,"threads_started":1}
I20260923 19:39:10.711616 28375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:10.710914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:36795)
0923 19:39:10.711350 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:10.711446 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":218,"threads_started":1}
I20260923 19:39:11.160190 28376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:11.159444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:44443)
0923 19:39:11.159919 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:11.160011 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":247,"threads_started":1}
I20260923 19:39:11.262715 28377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:11.261761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:39143)
0923 19:39:11.262366 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:11.262460 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":310,"threads_started":1}
I20260923 19:39:11.713498 28378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:11.712789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:56305)
0923 19:39:11.713212 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:11.713304 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":220,"threads_started":1}
I20260923 19:39:12.161970 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:12.161105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:38615)
0923 19:39:12.161598 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:12.161709 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":243,"threads_started":1}
I20260923 19:39:12.264775 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:12.263997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.193:57185)
0923 19:39:12.264480 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:12.264586 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":240,"threads_started":1}
I20260923 19:39:12.715341 28381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:12.714641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.194:53837)
0923 19:39:12.715084 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:12.715176 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":228,"threads_started":1}
I20260923 19:39:13.143882 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 27900
I20260923 19:39:13.162974 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:13.144992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48170 (local address 127.12.159.193:36033)
0923 19:39:13.145543 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:13.145551 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:13.145579 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:39:13.145647 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:13.145653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:13.145940 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:13.146067 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:13.147474 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:13.148423 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:13.149624 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:13.150253 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:13.150352 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:13.157125 (+ 6773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:13.157137 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:13.157152 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:13.157192 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:13.160206 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:13.160838 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:13.160844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:13.160846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:13.160974 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:13.161308 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:13.161311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:13.161313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:13.161681 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:13.161968 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:13.162280 (+ 312us) server_negotiation.cc:299] Negotiation successful
0923 19:39:13.162575 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":279,"threads_started":1}
I20260923 19:39:13.163955 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:13.163126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45659 (local address 127.12.159.195:36805)
0923 19:39:13.163615 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:13.163770 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":236,"threads_started":1}
I20260923 19:39:13.164424 28059 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:13.254408 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 27900
I20260923 19:39:13.272181 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 28068
I20260923 19:39:13.285712 28385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:13.272987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55650 (local address 127.12.159.194:43283)
0923 19:39:13.273505 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:13.273510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:13.273526 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:39:13.273581 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:13.273584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:13.273648 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:13.273739 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:13.275120 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:13.275895 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:13.277114 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:13.277538 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:13.277636 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:13.280531 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:13.280535 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:13.280539 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:13.280574 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:13.283267 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:13.283953 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:13.283957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:13.283959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:13.284101 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:13.284421 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:13.284424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:13.284426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:13.284696 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:13.284899 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:13.285113 (+ 214us) server_negotiation.cc:299] Negotiation successful
0923 19:39:13.285284 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":305,"threads_started":1}
I20260923 19:39:13.286415 28191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:13.370919 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 28068
I20260923 19:39:13.389235 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 28199
I20260923 19:39:13.403100 28387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:13.390189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53474 (local address 127.12.159.195:33411)
0923 19:39:13.390762 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:13.390768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:13.390784 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:39:13.390839 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:13.390842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:13.390910 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:13.391003 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:13.392463 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:13.393280 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:13.394689 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:13.395090 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:13.395182 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:13.397773 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:13.397778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:13.397782 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:13.397878 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:13.400643 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:13.401339 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:13.401342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:13.401344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:13.401468 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:13.401791 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:13.401794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:13.401796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:13.402098 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:13.402311 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:13.402546 (+ 235us) server_negotiation.cc:299] Negotiation successful
0923 19:39:13.402712 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":302,"threads_started":1}
I20260923 19:39:13.403874 28322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:13.489099 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 28199
2026-09-23T19:39:13Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24594 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:39:13 dist-test-slave-lzv7 krb5kdc[28391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:39:13 dist-test-slave-lzv7 krb5kdc[28391](info): set up 2 sockets
Sep 23 19:39:13 dist-test-slave-lzv7 krb5kdc[28391](info): commencing operation
krb5kdc: starting...
W20260923 19:39:14.594532 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.009s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:39:14 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:39:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:39:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:39:14.845417 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45231
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:39:15.180424 28404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:15.180742 28404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:15.180903 28404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:15.188319 28404 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 19:39:15.188423 28404 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 19:39:15.188505 28404 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 19:39:15.188583 28404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:39:15.188658 28404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:15.188759 28404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:15.188843 28404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:39:15.188944 28404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:39:15.199172 28404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:15.200538 28404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:15.201965 28404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:39:15.214599 28412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:15.214592 28410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:15.215023 28409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:15.215502 28404 server_base.cc:1034] running on GCE node
I20260923 19:39:15.216281 28404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:15.217886 28404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:15.219141 28404 hybrid_clock.cc:648] HybridClock initialized: now 1790192355219076 us; error 44 us; skew 500 ppm
I20260923 19:39:15.219560 28404 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:15 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:15.223034 28404 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:39:15.224654 28404 webserver.cc:460] Webserver started at http://127.12.159.254:33837/ using document root <none> and password file <none>
I20260923 19:39:15.225517 28404 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:15.225679 28404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:15.226082 28404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:39:15.229235 28404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "28eeab82de0749c4acea7bc433d04960"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "c7343b02c94e1ea6a8cd4400df1e5945"
server_key_iv: "b850c296f85d109865a4346db33009b8"
server_key_version: "encryptionkey@0"
I20260923 19:39:15.230129 28404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "28eeab82de0749c4acea7bc433d04960"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "c7343b02c94e1ea6a8cd4400df1e5945"
server_key_iv: "b850c296f85d109865a4346db33009b8"
server_key_version: "encryptionkey@0"
I20260923 19:39:15.235452 28404 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:39:15.238946 28419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:15.240569 28404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:39:15.240775 28404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "28eeab82de0749c4acea7bc433d04960"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "c7343b02c94e1ea6a8cd4400df1e5945"
server_key_iv: "b850c296f85d109865a4346db33009b8"
server_key_version: "encryptionkey@0"
I20260923 19:39:15.241004 28404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:15.274385 28404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:15.278957 28404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:15.279271 28404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:15.299919 28404 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45231
I20260923 19:39:15.299970 28470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45231 every 8 connection(s)
I20260923 19:39:15.301509 28404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:39:15.305612 28471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:39:15.310103 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 28404
I20260923 19:39:15.310346 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:39:15.311060 12927 external_mini_cluster.cc:1428] Setting key ed1e1128e364348c82e76e2af534736f
I20260923 19:39:15.316902 28471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Bootstrap starting.
I20260923 19:39:15.320075 28471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Neither blocks nor log segments found. Creating new log.
I20260923 19:39:15.321082 28471 log.cc:824] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:15.324836 28471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: No bootstrap required, opened a new log
Sep 23 19:39:15 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:39:15.336362 28471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:15.336894 28471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:39:15.337059 28474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:15.313111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34120 (local address 127.12.159.254:45231)
0923 19:39:15.313987 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:15.313999 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:15.314040 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:39:15.315790 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:15.315814 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:15.316195 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:15.316574 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:15.318124 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:15.319538 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:15.321059 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:15.322223 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:15.322517 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:15.327470 (+ 4953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:15.327485 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:15.327505 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:15.327558 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:15.331839 (+ 4281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:15.332617 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:15.332626 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:15.332637 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:15.332864 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:15.333286 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:15.333295 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:15.333301 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:15.334219 (+ 918us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:15.334551 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:15.334954 (+ 403us) server_negotiation.cc:299] Negotiation successful
0923 19:39:15.335474 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":375,"threads_started":1}
I20260923 19:39:15.337028 28471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28eeab82de0749c4acea7bc433d04960, State: Initialized, Role: FOLLOWER
I20260923 19:39:15.337718 28471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:15.338084 28471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:39:15.338254 28471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:39:15.338459 28471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:39:15.341023 28471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:15.341562 28471 leader_election.cc:302] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28eeab82de0749c4acea7bc433d04960; no voters:
I20260923 19:39:15.342234 28471 leader_election.cc:288] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:39:15.342339 28476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:39:15.343088 28476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 LEADER]: Becoming Leader. State: Replica: 28eeab82de0749c4acea7bc433d04960, State: Running, Role: LEADER
I20260923 19:39:15.343639 28476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:15.344609 28471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:39:15.346632 28477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28eeab82de0749c4acea7bc433d04960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } } }
I20260923 19:39:15.347241 28477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: This master's current role is: LEADER
I20260923 19:39:15.347152 28478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28eeab82de0749c4acea7bc433d04960. Latest consensus state: current_term: 1 leader_uuid: "28eeab82de0749c4acea7bc433d04960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } } }
I20260923 19:39:15.347452 28478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: This master's current role is: LEADER
I20260923 19:39:15.349968 28482 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:39:15.355042 28482 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:39:15.364276 28482 catalog_manager.cc:1347] Generated new cluster ID: 302fb7403b164078a380c9d8f22bd0b3
I20260923 19:39:15.364472 28482 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:39:15.385543 28482 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:39:15.386998 28482 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:39:15.396908 28482 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Generated new TSK 0
I20260923 19:39:15.397931 28482 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:39:15.461768 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45231
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:39:15.800474 28497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:15.800762 28497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:15.800858 28497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:15.808183 28497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:15.808315 28497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:15.808429 28497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:39:15.818610 28497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:15.819856 28497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:15.821202 28497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:39:15.835021 28502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:15.835000 28505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:15.834952 28503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:15.836283 28497 server_base.cc:1034] running on GCE node
I20260923 19:39:15.837040 28497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:15.838279 28497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:15.839504 28497 hybrid_clock.cc:648] HybridClock initialized: now 1790192355839436 us; error 51 us; skew 500 ppm
I20260923 19:39:15.839812 28497 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:15 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:15.843180 28497 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:39:15.844944 28497 webserver.cc:460] Webserver started at http://127.12.159.193:36411/ using document root <none> and password file <none>
I20260923 19:39:15.845939 28497 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:15.846096 28497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:15.846426 28497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:39:15.849506 28497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "13a30378f9bd4809a6c9bf519670c49c"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "3b39a5a341b8f2259b51b71547c160e7"
server_key_iv: "5f206d924fc1f625e84b8edf509338a5"
server_key_version: "encryptionkey@0"
I20260923 19:39:15.850386 28497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "13a30378f9bd4809a6c9bf519670c49c"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "3b39a5a341b8f2259b51b71547c160e7"
server_key_iv: "5f206d924fc1f625e84b8edf509338a5"
server_key_version: "encryptionkey@0"
I20260923 19:39:15.856017 28497 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:39:15.859792 28512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:15.861194 28497 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:39:15.861392 28497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "13a30378f9bd4809a6c9bf519670c49c"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "3b39a5a341b8f2259b51b71547c160e7"
server_key_iv: "5f206d924fc1f625e84b8edf509338a5"
server_key_version: "encryptionkey@0"
I20260923 19:39:15.861608 28497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:15.890396 28497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:15.894879 28497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:15.895218 28497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:15.896276 28497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:39:15.897756 28497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:39:15.897846 28497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260923 19:39:15.898023 28497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:39:15.898085 28497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:15.932880 28497 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:45881
I20260923 19:39:15.932921 28624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:45881 every 8 connection(s)
I20260923 19:39:15.934209 28497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:39:15.937479 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 28497
I20260923 19:39:15.937726 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:39:15.938644 12927 external_mini_cluster.cc:1428] Setting key 11138f896b92d80fb17b9d3f6deb4acd
Sep 23 19:39:15 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192355, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:39:15.957264 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:15.937086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:49931 (local address 127.12.159.254:45231)
0923 19:39:15.937597 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:15.937604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:15.938822 (+ 1218us) server_negotiation.cc:407] Connection header received
0923 19:39:15.941028 (+ 2206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:15.941032 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:15.941094 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:15.941184 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:15.943399 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:15.944155 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:15.946888 (+ 2733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:15.947309 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:15.947415 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:15.951471 (+ 4056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:15.951476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:15.951479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:15.951510 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:15.954113 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:15.954918 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:15.954922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:15.954924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:15.955043 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:15.955503 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:15.955506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:15.955508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:15.955762 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:15.955941 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:15.956677 (+ 736us) server_negotiation.cc:299] Negotiation successful
0923 19:39:15.956895 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":252,"threads_started":1}
I20260923 19:39:15.958328 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:15.937623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:49931)
0923 19:39:15.938562 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:15.938625 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:15.940724 (+ 2099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:15.941481 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:15.941492 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:15.942312 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:39:15.943207 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:15.943236 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:15.944340 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:15.944349 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:15.946720 (+ 2371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:15.946739 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:15.947555 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:15.947564 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:15.947895 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:15.948624 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:39:15.948658 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:39:15.951230 (+ 2572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:39:15.954258 (+ 3028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:15.954267 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:15.954284 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:15.954785 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:15.955153 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:15.955158 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:15.955161 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:15.955351 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:15.955913 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:39:15.955921 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:39:15.956295 (+ 374us) client_negotiation.cc:769] Sending connection context
0923 19:39:15.956566 (+ 271us) client_negotiation.cc:240] Negotiation successful
0923 19:39:15.957112 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":374,"threads_started":1}
I20260923 19:39:15.960170 28625 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45231
I20260923 19:39:15.960490 28625 heartbeater.cc:464] Registering TS with master...
I20260923 19:39:15.961202 28625 heartbeater.cc:511] Master 127.12.159.254:45231 requested a full tablet report, sending...
I20260923 19:39:15.963707 28436 ts_manager.cc:194] Registered new tserver with Master: 13a30378f9bd4809a6c9bf519670c49c (127.12.159.193:45881)
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:39:15.965405 28436 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:49931
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:39:15.994755 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45231
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:39:16.322371 28631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:16.322687 28631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:16.322861 28631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:16.330027 28631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:16.330178 28631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:16.330355 28631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:39:16.340123 28631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:16.341459 28631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:16.342811 28631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:39:16.356452 28637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:16.356554 28639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:16.356366 28636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:16.357501 28631 server_base.cc:1034] running on GCE node
I20260923 19:39:16.358215 28631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:16.359279 28631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:16.360512 28631 hybrid_clock.cc:648] HybridClock initialized: now 1790192356360460 us; error 47 us; skew 500 ppm
I20260923 19:39:16.360837 28631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:16 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192356, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:16.364199 28631 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:39:16.365916 28631 webserver.cc:460] Webserver started at http://127.12.159.194:41727/ using document root <none> and password file <none>
I20260923 19:39:16.366722 28631 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:16.366858 28631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:16.367216 28631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:39:16.370230 28631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "ccf2fd8b8d5142328ac254df1ec44d8f"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "9bd21c314ba5a50e7ba6256391e4b37f"
server_key_iv: "388be604ff7e0aecdbf628fe496c4bcf"
server_key_version: "encryptionkey@0"
I20260923 19:39:16.371030 28631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "ccf2fd8b8d5142328ac254df1ec44d8f"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "9bd21c314ba5a50e7ba6256391e4b37f"
server_key_iv: "388be604ff7e0aecdbf628fe496c4bcf"
server_key_version: "encryptionkey@0"
I20260923 19:39:16.376175 28631 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:39:16.379737 28646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:16.381009 28631 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:39:16.381183 28631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "ccf2fd8b8d5142328ac254df1ec44d8f"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "9bd21c314ba5a50e7ba6256391e4b37f"
server_key_iv: "388be604ff7e0aecdbf628fe496c4bcf"
server_key_version: "encryptionkey@0"
I20260923 19:39:16.381377 28631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:16.424850 28631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:16.429718 28631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:16.430116 28631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:16.431125 28631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:39:16.432498 28631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:39:16.432571 28631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:16.432701 28631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:39:16.432751 28631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:16.466395 28631 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:43687
I20260923 19:39:16.466464 28758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:43687 every 8 connection(s)
I20260923 19:39:16.468060 28631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:39:16.468629 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 28631
I20260923 19:39:16.468863 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:39:16.469547 12927 external_mini_cluster.cc:1428] Setting key b1f8361b618f8f24518c0f49bbce9955
Sep 23 19:39:16 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192356, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:39:16.489147 28761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:16.471335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:42433 (local address 127.12.159.254:45231)
0923 19:39:16.471784 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:16.471788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:16.472731 (+ 943us) server_negotiation.cc:407] Connection header received
0923 19:39:16.474821 (+ 2090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:16.474827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:16.474930 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:16.475047 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:16.476583 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:16.477345 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:16.478972 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:16.479399 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:16.479536 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:16.483191 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:16.483196 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:16.483199 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:16.483229 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:16.485936 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:16.486900 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:16.486904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:16.486906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:16.487029 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:16.487502 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:16.487505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:16.487507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:16.487748 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:16.487866 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:16.488712 (+ 846us) server_negotiation.cc:299] Negotiation successful
0923 19:39:16.488871 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":237,"threads_started":1}
I20260923 19:39:16.490723 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:16.471932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:42433)
0923 19:39:16.472571 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:16.472616 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:16.474546 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:16.475318 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:16.475327 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:16.475843 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:39:16.476413 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:16.476430 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:16.477509 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:16.477513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:16.478816 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:16.478828 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:16.479632 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:16.479639 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:16.479870 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:16.480573 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:39:16.480608 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:39:16.482957 (+ 2349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:39:16.486124 (+ 3167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:16.486135 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:16.486153 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:16.486778 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:16.487141 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:16.487148 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:16.487155 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:16.487393 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:16.487877 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:39:16.487886 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:39:16.488354 (+ 468us) client_negotiation.cc:769] Sending connection context
0923 19:39:16.488637 (+ 283us) client_negotiation.cc:240] Negotiation successful
0923 19:39:16.489208 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":795,"threads_started":1}
I20260923 19:39:16.492355 28759 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45231
I20260923 19:39:16.492681 28759 heartbeater.cc:464] Registering TS with master...
I20260923 19:39:16.493366 28759 heartbeater.cc:511] Master 127.12.159.254:45231 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:39:16.494917 28436 ts_manager.cc:194] Registered new tserver with Master: ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687)
I20260923 19:39:16.495754 28436 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:42433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:39:16.524716 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45231
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:39:16.856892 28765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:16.857187 28765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:16.857381 28765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:16.864893 28765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:16.865058 28765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:16.865187 28765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:39:16.875581 28765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:16.876860 28765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:16.878125 28765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:39:16.891623 28770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:16.891654 28771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:16.891615 28773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:16.892340 28765 server_base.cc:1034] running on GCE node
I20260923 19:39:16.892871 28765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:16.893795 28765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:16.895079 28765 hybrid_clock.cc:648] HybridClock initialized: now 1790192356895032 us; error 30 us; skew 500 ppm
I20260923 19:39:16.895437 28765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:16 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192356, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:16.902745 28765 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:39:16.904364 28765 webserver.cc:460] Webserver started at http://127.12.159.195:33979/ using document root <none> and password file <none>
I20260923 19:39:16.905072 28765 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:16.905180 28765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:16.905440 28765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:39:16.908536 28765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "7ee8621c654b4b5f8ed8c071146870c7"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "a01df33aea5daa272d6e0b620bfe3c94"
server_key_iv: "3fe83194f45982b5c097b7b46cc2d79a"
server_key_version: "encryptionkey@0"
I20260923 19:39:16.909299 28765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "7ee8621c654b4b5f8ed8c071146870c7"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "a01df33aea5daa272d6e0b620bfe3c94"
server_key_iv: "3fe83194f45982b5c097b7b46cc2d79a"
server_key_version: "encryptionkey@0"
I20260923 19:39:16.914609 28765 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260923 19:39:16.918126 28780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:16.919479 28765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:39:16.919678 28765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "7ee8621c654b4b5f8ed8c071146870c7"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "a01df33aea5daa272d6e0b620bfe3c94"
server_key_iv: "3fe83194f45982b5c097b7b46cc2d79a"
server_key_version: "encryptionkey@0"
I20260923 19:39:16.919878 28765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:16.949047 28765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:16.953493 28765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:16.953795 28765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:16.954795 28765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:39:16.956156 28765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:39:16.956261 28765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:16.956410 28765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:39:16.956481 28765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:16.969221 28625 heartbeater.cc:503] Master 127.12.159.254:45231 was elected leader, sending a full tablet report...
I20260923 19:39:16.988648 28765 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:40349
I20260923 19:39:16.988688 28892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:40349 every 8 connection(s)
I20260923 19:39:16.990080 28765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:39:16.990617 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 28765
I20260923 19:39:16.990850 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:39:16.991448 12927 external_mini_cluster.cc:1428] Setting key 8a37d910c077800d0744214821d416be
Sep 23 19:39:16 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192356, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:39:17.013438 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:16.993403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:46511 (local address 127.12.159.254:45231)
0923 19:39:16.994077 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:16.994085 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:16.995012 (+ 927us) server_negotiation.cc:407] Connection header received
0923 19:39:16.997009 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:16.997015 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:16.997127 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:16.997255 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:16.998888 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:16.999704 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.001361 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.001786 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.001960 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.005655 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:17.005662 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:17.005667 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:17.005711 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:17.009031 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.009796 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.009821 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.009825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.010008 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.010952 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.010958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.010961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.011361 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:17.011547 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.012566 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.012831 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":392,"threads_started":1}
I20260923 19:39:17.014659 28896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:16.993845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:46511)
0923 19:39:16.994846 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:16.994898 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:16.996725 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:16.997498 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:16.997506 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:16.998104 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:39:16.998709 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:16.998728 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:16.999894 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:16.999899 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.001201 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.001214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.002052 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.002061 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.002334 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.003096 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:39:17.003122 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:39:17.005398 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:39:17.009186 (+ 3788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:17.009192 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:17.009204 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:17.009622 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:17.010164 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:17.010171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:17.010177 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:17.010459 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:17.011567 (+ 1108us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:39:17.011577 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:39:17.012036 (+ 459us) client_negotiation.cc:769] Sending connection context
0923 19:39:17.012350 (+ 314us) client_negotiation.cc:240] Negotiation successful
0923 19:39:17.012992 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":335,"threads_started":1}
I20260923 19:39:17.016944 28893 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45231
I20260923 19:39:17.017315 28893 heartbeater.cc:464] Registering TS with master...
I20260923 19:39:17.018617 28893 heartbeater.cc:511] Master 127.12.159.254:45231 requested a full tablet report, sending...
I20260923 19:39:17.020958 28435 ts_manager.cc:194] Registered new tserver with Master: 7ee8621c654b4b5f8ed8c071146870c7 (127.12.159.195:40349)
I20260923 19:39:17.022562 28435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:46511
I20260923 19:39:17.022921 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:39:17.049597 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.031072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34136 (local address 127.12.159.254:45231)
0923 19:39:17.031333 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.031349 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.031974 (+ 625us) server_negotiation.cc:407] Connection header received
0923 19:39:17.032215 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.032222 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.032305 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.032421 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:17.034383 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.035713 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.037960 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.038723 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.038876 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.042102 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:17.042108 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:17.042111 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:17.042146 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:17.046551 (+ 4405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.047338 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.047344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.047348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.047492 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.047931 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.047937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.047940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.048292 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:17.048561 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.048975 (+ 414us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.049209 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:39:17.054466 28435 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:39:17.061724 28435 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:39:17.098882 28907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.074674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.12.159.194:43687)
0923 19:39:17.089965 (+ 15291us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.089976 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.090008 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:39:17.090115 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.090126 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.090431 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.090669 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:17.092489 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.094021 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.095949 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.097393 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.097582 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.097767 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.098332 (+ 565us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.098516 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15089,"thread_start_us":15493,"threads_started":1}
I20260923 19:39:17.098958 28909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.074972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:40349 (local address 127.0.0.1:60000)
0923 19:39:17.086495 (+ 11523us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:17.086546 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:17.086733 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:17.091422 (+ 4689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:17.091427 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:17.091450 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:17.091979 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.091992 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.093356 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.093364 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.096126 (+ 2762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.096140 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.097775 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.097781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.098041 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.098117 (+ 76us) client_negotiation.cc:769] Sending connection context
0923 19:39:17.098247 (+ 130us) client_negotiation.cc:240] Negotiation successful
0923 19:39:17.098514 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11352,"mutex_wait_us":121,"thread_start_us":9458,"threads_started":1}
I20260923 19:39:17.099848 28911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.076329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60582 (local address 127.12.159.193:45881)
0923 19:39:17.089689 (+ 13360us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.089698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.090077 (+ 379us) server_negotiation.cc:407] Connection header received
0923 19:39:17.090250 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.090261 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.090598 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.090803 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:17.091901 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.093595 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.096288 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.097768 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.098013 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.098182 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.099369 (+ 1187us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.099528 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13137,"thread_start_us":12943,"threads_started":1}
I20260923 19:39:17.099844 28908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.074456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43687 (local address 127.0.0.1:39230)
0923 19:39:17.087442 (+ 12986us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:17.087465 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:17.087617 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:17.090969 (+ 3352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:17.090976 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:17.091007 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:17.092321 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.092333 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.094158 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.094163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.095790 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.095803 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.097972 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.097980 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.098142 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.098172 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 19:39:17.098274 (+ 102us) client_negotiation.cc:240] Negotiation successful
0923 19:39:17.099448 (+ 1174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10147,"mutex_wait_us":1847,"thread_start_us":15184,"threads_started":1}
I20260923 19:39:17.100270 28906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.075631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:60582)
0923 19:39:17.089925 (+ 14294us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:17.089946 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:17.090092 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:17.091081 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:17.091088 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:17.091120 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:17.091630 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.091643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.093739 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.093743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.096125 (+ 2382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.096140 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.098334 (+ 2194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.098342 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.098530 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.098557 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 19:39:17.098640 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 19:39:17.098769 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14145,"mutex_wait_us":46,"thread_start_us":10506,"threads_started":1}
I20260923 19:39:17.101241 28910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.075651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60000 (local address 127.12.159.195:40349)
0923 19:39:17.090882 (+ 15231us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.090892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.090924 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:39:17.091008 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.091015 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.091249 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.091530 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:17.092165 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.093216 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.096326 (+ 3110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.097566 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.098502 (+ 936us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.098682 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.098745 (+ 63us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.098913 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15042,"thread_start_us":14878,"threads_started":1}
I20260923 19:39:17.103545 28560 tablet_service.cc:1467] Processing CreateTablet for tablet b7cec8d042b349638416f7cf86c068e7 (DEFAULT_TABLE table=test-table [id=0bf4c47ee18643f7848a6d0b03db8fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:39:17.103785 28694 tablet_service.cc:1467] Processing CreateTablet for tablet b7cec8d042b349638416f7cf86c068e7 (DEFAULT_TABLE table=test-table [id=0bf4c47ee18643f7848a6d0b03db8fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:39:17.105069 28560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7cec8d042b349638416f7cf86c068e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:39:17.105163 28694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7cec8d042b349638416f7cf86c068e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:39:17.104728 28828 tablet_service.cc:1467] Processing CreateTablet for tablet b7cec8d042b349638416f7cf86c068e7 (DEFAULT_TABLE table=test-table [id=0bf4c47ee18643f7848a6d0b03db8fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:39:17.106050 28828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7cec8d042b349638416f7cf86c068e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:39:17.116271 28912 tablet_bootstrap.cc:492] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Bootstrap starting.
I20260923 19:39:17.119769 28912 tablet_bootstrap.cc:654] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Neither blocks nor log segments found. Creating new log.
I20260923 19:39:17.119900 28914 tablet_bootstrap.cc:492] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Bootstrap starting.
I20260923 19:39:17.121285 28912 log.cc:824] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:17.122550 28913 tablet_bootstrap.cc:492] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Bootstrap starting.
I20260923 19:39:17.123992 28914 tablet_bootstrap.cc:654] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Neither blocks nor log segments found. Creating new log.
I20260923 19:39:17.125310 28914 log.cc:824] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:17.126336 28913 tablet_bootstrap.cc:654] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Neither blocks nor log segments found. Creating new log.
I20260923 19:39:17.127112 28912 tablet_bootstrap.cc:492] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: No bootstrap required, opened a new log
I20260923 19:39:17.127416 28913 log.cc:824] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:17.127460 28912 ts_tablet_manager.cc:1397] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.008s
I20260923 19:39:17.129966 28913 tablet_bootstrap.cc:492] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: No bootstrap required, opened a new log
I20260923 19:39:17.130239 28913 ts_tablet_manager.cc:1397] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:39:17.132490 28914 tablet_bootstrap.cc:492] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: No bootstrap required, opened a new log
I20260923 19:39:17.132745 28914 ts_tablet_manager.cc:1397] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260923 19:39:17.137322 28913 raft_consensus.cc:348] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.137759 28913 raft_consensus.cc:374] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:39:17.137878 28913 raft_consensus.cc:729] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee8621c654b4b5f8ed8c071146870c7, State: Initialized, Role: FOLLOWER
I20260923 19:39:17.138520 28913 consensus_queue.cc:260] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.138581 28912 raft_consensus.cc:348] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.138994 28912 raft_consensus.cc:374] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:39:17.139075 28912 raft_consensus.cc:729] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13a30378f9bd4809a6c9bf519670c49c, State: Initialized, Role: FOLLOWER
I20260923 19:39:17.139819 28893 heartbeater.cc:503] Master 127.12.159.254:45231 was elected leader, sending a full tablet report...
I20260923 19:39:17.139742 28912 consensus_queue.cc:260] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.140475 28913 ts_tablet_manager.cc:1428] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20260923 19:39:17.143482 28914 raft_consensus.cc:348] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.143931 28914 raft_consensus.cc:374] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:39:17.144039 28914 raft_consensus.cc:729] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf2fd8b8d5142328ac254df1ec44d8f, State: Initialized, Role: FOLLOWER
I20260923 19:39:17.144747 28914 consensus_queue.cc:260] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.145924 28759 heartbeater.cc:503] Master 127.12.159.254:45231 was elected leader, sending a full tablet report...
I20260923 19:39:17.146044 28918 raft_consensus.cc:482] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:39:17.146402 28912 ts_tablet_manager.cc:1428] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Time spent starting tablet: real 0.019s user 0.012s sys 0.004s
I20260923 19:39:17.146297 28918 raft_consensus.cc:504] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.146601 28914 ts_tablet_manager.cc:1428] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260923 19:39:17.148132 28918 leader_election.cc:288] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687), 13a30378f9bd4809a6c9bf519670c49c (127.12.159.193:45881)
I20260923 19:39:17.154377 28907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.148566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:49975 (local address 127.12.159.194:43687)
0923 19:39:17.149084 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.149089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.149108 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:39:17.149295 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.149303 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.149377 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.149480 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:17.149898 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.150893 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.152672 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.153442 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.153606 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.153676 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.154004 (+ 328us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.154133 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375}
I20260923 19:39:17.154424 28896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.148593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43687 (local address 127.12.159.195:49975)
0923 19:39:17.148947 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:17.148968 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:17.149106 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:17.149499 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:17.149503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:17.149529 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:17.149740 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.149752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.151018 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.151026 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.152525 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.152536 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.153602 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.153608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.153792 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.153867 (+ 75us) client_negotiation.cc:769] Sending connection context
0923 19:39:17.153978 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 19:39:17.154109 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":22}
I20260923 19:39:17.155242 28911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.148615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:60851 (local address 127.12.159.193:45881)
0923 19:39:17.148788 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.148797 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.149499 (+ 702us) server_negotiation.cc:407] Connection header received
0923 19:39:17.149737 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.149742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.149848 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.149927 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:17.150546 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.151465 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.153131 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.154059 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.154231 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.154299 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.154793 (+ 494us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.154931 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260923 19:39:17.155611 28714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7cec8d042b349638416f7cf86c068e7" candidate_uuid: "7ee8621c654b4b5f8ed8c071146870c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" is_pre_election: true
I20260923 19:39:17.155884 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.148703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.12.159.195:60851)
0923 19:39:17.149408 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:17.149425 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:17.149606 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:17.149957 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:17.149964 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:17.149990 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:17.150346 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.150358 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.151613 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.151618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.152973 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:17.152984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.154254 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.154260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:17.154581 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.154639 (+ 58us) client_negotiation.cc:769] Sending connection context
0923 19:39:17.155495 (+ 856us) client_negotiation.cc:240] Negotiation successful
0923 19:39:17.155590 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"mutex_wait_us":23,"thread_start_us":406,"threads_started":1}
I20260923 19:39:17.156144 28714 raft_consensus.cc:2454] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee8621c654b4b5f8ed8c071146870c7 in term 0.
I20260923 19:39:17.156867 28783 leader_election.cc:302] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ee8621c654b4b5f8ed8c071146870c7, ccf2fd8b8d5142328ac254df1ec44d8f; no voters:
I20260923 19:39:17.156836 28580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7cec8d042b349638416f7cf86c068e7" candidate_uuid: "7ee8621c654b4b5f8ed8c071146870c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13a30378f9bd4809a6c9bf519670c49c" is_pre_election: true
I20260923 19:39:17.157235 28918 raft_consensus.cc:2781] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:39:17.157346 28918 raft_consensus.cc:482] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:39:17.157334 28580 raft_consensus.cc:2454] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee8621c654b4b5f8ed8c071146870c7 in term 0.
I20260923 19:39:17.157466 28918 raft_consensus.cc:3037] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:39:17.159808 28918 raft_consensus.cc:504] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.160432 28918 leader_election.cc:288] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [CANDIDATE]: Term 1 election: Requested vote from peers ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687), 13a30378f9bd4809a6c9bf519670c49c (127.12.159.193:45881)
I20260923 19:39:17.160851 28714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7cec8d042b349638416f7cf86c068e7" candidate_uuid: "7ee8621c654b4b5f8ed8c071146870c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f"
I20260923 19:39:17.160952 28580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7cec8d042b349638416f7cf86c068e7" candidate_uuid: "7ee8621c654b4b5f8ed8c071146870c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13a30378f9bd4809a6c9bf519670c49c"
I20260923 19:39:17.161060 28714 raft_consensus.cc:3037] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:39:17.161149 28580 raft_consensus.cc:3037] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:39:17.164377 28580 raft_consensus.cc:2454] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee8621c654b4b5f8ed8c071146870c7 in term 1.
I20260923 19:39:17.164377 28714 raft_consensus.cc:2454] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee8621c654b4b5f8ed8c071146870c7 in term 1.
I20260923 19:39:17.164821 28783 leader_election.cc:302] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ee8621c654b4b5f8ed8c071146870c7, ccf2fd8b8d5142328ac254df1ec44d8f; no voters:
I20260923 19:39:17.165105 28918 raft_consensus.cc:2781] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:39:17.165580 28918 raft_consensus.cc:686] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 LEADER]: Becoming Leader. State: Replica: 7ee8621c654b4b5f8ed8c071146870c7, State: Running, Role: LEADER
I20260923 19:39:17.166183 28918 consensus_queue.cc:237] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } }
I20260923 19:39:17.171026 28435 catalog_manager.cc:5495] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ee8621c654b4b5f8ed8c071146870c7 (127.12.159.195). New cstate: current_term: 1 leader_uuid: "7ee8621c654b4b5f8ed8c071146870c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } health_report { overall_health: UNKNOWN } } }
I20260923 19:39:17.186141 28910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.180966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.12.159.195:40349)
0923 19:39:17.181157 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.181161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.181178 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:39:17.181349 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.181355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.181430 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.181550 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:39:17.181948 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.182692 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.184209 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.184610 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.184697 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.185126 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:39:17.185612 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:39:17.185721 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.185797 (+ 76us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.185925 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 19:39:17.186748 28626 tablet.cc:2369] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:39:17.194015 28580 raft_consensus.cc:1261] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 1 FOLLOWER]: Refusing update from remote peer 7ee8621c654b4b5f8ed8c071146870c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:39:17.194061 28714 raft_consensus.cc:1261] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Refusing update from remote peer 7ee8621c654b4b5f8ed8c071146870c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:39:17.195000 28922 consensus_queue.cc:1035] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:39:17.195334 28918 consensus_queue.cc:1035] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:39:17.206998 28925 mvcc.cc:205] Tried to move back new op lower bound from 7332627895057293312 to 7332627894956838912. Current Snapshot: MvccSnapshot[applied={T|T < 7332627895057293312}]
I20260923 19:39:17.211684 28926 mvcc.cc:205] Tried to move back new op lower bound from 7332627895057293312 to 7332627894956838912. Current Snapshot: MvccSnapshot[applied={T|T < 7332627895057293312}]
I20260923 19:39:17.222076 28436 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:39:17.222342 28436 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:39:17.226100 28436 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Sending DeleteTablet for 3 replicas of tablet b7cec8d042b349638416f7cf86c068e7
I20260923 19:39:17.227370 28694 tablet_service.cc:1514] Processing DeleteTablet for tablet b7cec8d042b349638416f7cf86c068e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:39:17 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:39230
I20260923 19:39:17.227564 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 28497
I20260923 19:39:17.227701 28560 tablet_service.cc:1514] Processing DeleteTablet for tablet b7cec8d042b349638416f7cf86c068e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:39:17 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:60582
I20260923 19:39:17.228128 28828 tablet_service.cc:1514] Processing DeleteTablet for tablet b7cec8d042b349638416f7cf86c068e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:39:17 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:60000
I20260923 19:39:17.237953 28936 tablet_replica.cc:330] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: stopping tablet replica
I20260923 19:39:17.238364 28938 tablet_replica.cc:330] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: stopping tablet replica
I20260923 19:39:17.238449 28936 raft_consensus.cc:2229] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:39:17.238869 28938 raft_consensus.cc:2229] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:39:17.239024 28936 raft_consensus.cc:2258] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:39:17.239894 28938 raft_consensus.cc:2258] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:39:17.242589 28938 ts_tablet_manager.cc:1905] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:39:17.242627 28935 tablet_replica.cc:330] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: stopping tablet replica
I20260923 19:39:17.242990 28935 raft_consensus.cc:2229] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:39:17.243461 28935 raft_consensus.cc:2258] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:39:17.245694 28935 ts_tablet_manager.cc:1905] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:39:17.247145 28936 ts_tablet_manager.cc:1905] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:39:17 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:39:17.249934 28938 ts_tablet_manager.cc:1918] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:39:17.250090 28938 log.cc:1196] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/b7cec8d042b349638416f7cf86c068e7
I20260923 19:39:17.250598 28938 ts_tablet_manager.cc:1939] T b7cec8d042b349638416f7cf86c068e7 P 7ee8621c654b4b5f8ed8c071146870c7: Deleting consensus metadata
I20260923 19:39:17.252369 28420 catalog_manager.cc:4841] TS 7ee8621c654b4b5f8ed8c071146870c7 (127.12.159.195:40349): tablet b7cec8d042b349638416f7cf86c068e7 (table test-table [id=0bf4c47ee18643f7848a6d0b03db8fba]) successfully deleted
I20260923 19:39:17.252624 28935 ts_tablet_manager.cc:1918] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:39:17.252787 28935 log.cc:1196] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/b7cec8d042b349638416f7cf86c068e7
I20260923 19:39:17.253257 28935 ts_tablet_manager.cc:1939] T b7cec8d042b349638416f7cf86c068e7 P ccf2fd8b8d5142328ac254df1ec44d8f: Deleting consensus metadata
I20260923 19:39:17.254911 28422 catalog_manager.cc:4841] TS ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687): tablet b7cec8d042b349638416f7cf86c068e7 (table test-table [id=0bf4c47ee18643f7848a6d0b03db8fba]) successfully deleted
I20260923 19:39:17.256515 28936 ts_tablet_manager.cc:1918] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:39:17.256729 28936 log.cc:1196] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/b7cec8d042b349638416f7cf86c068e7
I20260923 19:39:17.257210 28936 ts_tablet_manager.cc:1939] T b7cec8d042b349638416f7cf86c068e7 P 13a30378f9bd4809a6c9bf519670c49c: Deleting consensus metadata
I20260923 19:39:17.258826 28421 catalog_manager.cc:4841] TS 13a30378f9bd4809a6c9bf519670c49c (127.12.159.193:45881): tablet b7cec8d042b349638416f7cf86c068e7 (table test-table [id=0bf4c47ee18643f7848a6d0b03db8fba]) successfully deleted
I20260923 19:39:17.259066 28911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.228904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60592 (local address 127.12.159.193:45881)
0923 19:39:17.229146 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.229156 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.237243 (+ 8087us) server_negotiation.cc:407] Connection header received
0923 19:39:17.237461 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.237468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.237571 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.237694 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:17.240211 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.241354 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.243658 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.244303 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.244416 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.250433 (+ 6017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:17.250446 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:17.250462 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:17.250513 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:17.254606 (+ 4093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.256158 (+ 1552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.256169 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.256172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.256354 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.256913 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.256918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.256922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.257415 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:17.257724 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.258421 (+ 697us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.258687 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 19:39:17.260293 28620 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:17.364832 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 28497
I20260923 19:39:17.382652 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 28631
Sep 23 19:39:17 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:39:17.400458 28907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.383509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39232 (local address 127.12.159.194:43687)
0923 19:39:17.383733 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.383742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.383765 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:39:17.383906 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.383912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.384005 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.384126 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:17.385690 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.386975 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.388511 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.389143 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.389273 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.393674 (+ 4401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:17.393690 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:17.393711 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:17.393756 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:17.397455 (+ 3699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.398372 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.398382 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.398386 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.398541 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.398885 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.398890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.398894 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.399379 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:17.399673 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.399858 (+ 185us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.400083 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260923 19:39:17.401168 28754 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:17.492923 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 28631
I20260923 19:39:17.516645 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 28765
Sep 23 19:39:17 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:39:17.534430 28910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:17.517467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60012 (local address 127.12.159.195:40349)
0923 19:39:17.517703 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:17.517708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:17.517732 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:39:17.518104 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:17.518110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:17.518221 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:17.518352 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:17.519804 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.520707 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.522183 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:17.522644 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:17.522799 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:17.527867 (+ 5068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:17.527879 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:17.527894 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:17.527934 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:17.531306 (+ 3372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.532245 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.532252 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.532254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.532418 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:17.532839 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:17.532842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:17.532843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:17.533194 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:17.533441 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:17.533906 (+ 465us) server_negotiation.cc:299] Negotiation successful
0923 19:39:17.534101 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:39:17.535259 28888 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:17.660421 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 28765
I20260923 19:39:17.680919 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 28404
I20260923 19:39:17.682180 28466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:17.793480 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 28404
I20260923 19:39:37.816098 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45231
--webserver_interface=127.12.159.254
--webserver_port=33837
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:39:38.153749 28943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:38.154139 28943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:38.154333 28943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:38.161726 28943 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 19:39:38.161877 28943 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 19:39:38.161957 28943 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 19:39:38.162073 28943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:39:38.162175 28943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:38.162295 28943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:38.162384 28943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:39:38.162464 28943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:39:38.172631 28943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=33837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:38.174006 28943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:38.175385 28943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 19:39:38.200718 28943 server_base.cc:1034] running on GCE node
W20260923 19:39:38.200631 28950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:38.200662 28949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:38.200631 28952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:38.202137 28943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:38.203837 28943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:38.205087 28943 hybrid_clock.cc:648] HybridClock initialized: now 1790192378205016 us; error 42 us; skew 500 ppm
I20260923 19:39:38.205510 28943 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:38 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:38.209528 28943 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:39:38.211493 28943 webserver.cc:460] Webserver started at http://127.12.159.254:33837/ using document root <none> and password file <none>
I20260923 19:39:38.212314 28943 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:38.212468 28943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:38.218992 28943 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260923 19:39:38.222293 28959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:38.224181 28943 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:39:38.224378 28943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "28eeab82de0749c4acea7bc433d04960"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "c7343b02c94e1ea6a8cd4400df1e5945"
server_key_iv: "b850c296f85d109865a4346db33009b8"
server_key_version: "encryptionkey@0"
I20260923 19:39:38.225545 28943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:38.239557 28943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:38.243757 28943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:38.244065 28943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:38.263764 28943 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45231
I20260923 19:39:38.263788 29010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45231 every 8 connection(s)
I20260923 19:39:38.265419 28943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:39:38.270603 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 28943
I20260923 19:39:38.271471 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:45881
--local_ip_for_outbound_sockets=127.12.159.193
--tserver_master_addrs=127.12.159.254:45231
--webserver_port=36411
--webserver_interface=127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:39:38.272795 29011 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:39:38.276262 29011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Bootstrap starting.
I20260923 19:39:38.296388 29011 log.cc:824] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:38.309474 29011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:39:38.310123 29011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Bootstrap complete.
I20260923 19:39:38.319556 29011 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:38.320421 29011 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28eeab82de0749c4acea7bc433d04960, State: Initialized, Role: FOLLOWER
I20260923 19:39:38.321053 29011 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:38.321310 29011 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:39:38.321453 29011 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:39:38.321646 29011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:39:38.325974 29011 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:38.326555 29011 leader_election.cc:302] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28eeab82de0749c4acea7bc433d04960; no voters:
I20260923 19:39:38.327229 29011 leader_election.cc:288] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:39:38.327379 29015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:39:38.328605 29015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 LEADER]: Becoming Leader. State: Replica: 28eeab82de0749c4acea7bc433d04960, State: Running, Role: LEADER
I20260923 19:39:38.329275 29015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:39:38.329695 29011 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:39:38.332234 29017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28eeab82de0749c4acea7bc433d04960. Latest consensus state: current_term: 2 leader_uuid: "28eeab82de0749c4acea7bc433d04960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } } }
I20260923 19:39:38.332258 29016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "28eeab82de0749c4acea7bc433d04960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } } }
I20260923 19:39:38.332679 29017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: This master's current role is: LEADER
I20260923 19:39:38.332680 29016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: This master's current role is: LEADER
I20260923 19:39:38.333961 29023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:39:38.349646 29023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:39:38.351948 29023 catalog_manager.cc:1259] Loaded cluster ID: 302fb7403b164078a380c9d8f22bd0b3
I20260923 19:39:38.352064 29023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:39:38.356338 29023 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:39:38.358031 29023 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Loaded TSK: 0
I20260923 19:39:38.400781 29023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Generated new TSK 1
I20260923 19:39:38.401350 29023 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 19:39:38.668251 29013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:38.668536 29013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:38.668689 29013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:38.676105 29013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:38.676222 29013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:38.676397 29013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:39:38.686779 29013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:45881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=36411
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:38.688165 29013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:38.689505 29013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:39:38.702994 29039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:38.703118 29038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:38.703197 29041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:38.704320 29013 server_base.cc:1034] running on GCE node
I20260923 19:39:38.704978 29013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:38.706108 29013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:38.707340 29013 hybrid_clock.cc:648] HybridClock initialized: now 1790192378707287 us; error 53 us; skew 500 ppm
I20260923 19:39:38.707671 29013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:38 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:38.711069 29013 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:39:38.712648 29013 webserver.cc:460] Webserver started at http://127.12.159.193:36411/ using document root <none> and password file <none>
I20260923 19:39:38.713351 29013 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:38.713519 29013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:38.719262 29013 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:39:38.722594 29048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:38.724146 29013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:39:38.724370 29013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "13a30378f9bd4809a6c9bf519670c49c"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "3b39a5a341b8f2259b51b71547c160e7"
server_key_iv: "5f206d924fc1f625e84b8edf509338a5"
server_key_version: "encryptionkey@0"
I20260923 19:39:38.725688 29013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:38.748741 29013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:38.753361 29013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:38.753650 29013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:38.754786 29013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:39:38.756275 29013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:39:38.756377 29013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:38.756528 29013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:39:38.756626 29013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:38.790135 29013 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:45881
I20260923 19:39:38.790238 29160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:45881 every 8 connection(s)
I20260923 19:39:38.791584 29013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:39:38.797003 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 29013
I20260923 19:39:38.797641 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:43687
--local_ip_for_outbound_sockets=127.12.159.194
--tserver_master_addrs=127.12.159.254:45231
--webserver_port=41727
--webserver_interface=127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:39:38 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:39:38.816982 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:38.794648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:40011)
0923 19:39:38.795529 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:38.795574 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:38.797412 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:38.798977 (+ 1565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:38.798989 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:38.799590 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:39:38.800119 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:38.800136 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:38.801766 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:38.801773 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:38.803124 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:38.803137 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:38.804196 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:38.804204 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:38.804499 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:38.805212 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:39:38.805234 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:39:38.807900 (+ 2666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:39:38.811878 (+ 3978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:38.811888 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:38.811906 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:38.812486 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:38.812986 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:38.812994 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:38.812998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:38.813257 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:38.814181 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:39:38.814190 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:39:38.814560 (+ 370us) client_negotiation.cc:769] Sending connection context
0923 19:39:38.814874 (+ 314us) client_negotiation.cc:240] Negotiation successful
0923 19:39:38.815540 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":368,"threads_started":1}
I20260923 19:39:38.816975 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:38.794428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:40011 (local address 127.12.159.254:45231)
0923 19:39:38.795032 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:38.795044 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:38.795697 (+ 653us) server_negotiation.cc:407] Connection header received
0923 19:39:38.798060 (+ 2363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:38.798075 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:38.798452 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:38.798812 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:38.800360 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:38.801588 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:38.803284 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:38.803948 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:38.804159 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:38.808232 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:38.808242 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:38.808258 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:38.808304 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:38.811661 (+ 3357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:38.812657 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:38.812665 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:38.812671 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:38.812852 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:38.813408 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:38.813412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:38.813415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:38.814023 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:38.814243 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:38.815128 (+ 885us) server_negotiation.cc:299] Negotiation successful
0923 19:39:38.815567 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":261,"threads_started":1}
I20260923 19:39:38.820452 29161 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45231
I20260923 19:39:38.820785 29161 heartbeater.cc:464] Registering TS with master...
I20260923 19:39:38.821614 29161 heartbeater.cc:511] Master 127.12.159.254:45231 requested a full tablet report, sending...
I20260923 19:39:38.824092 28976 ts_manager.cc:194] Registered new tserver with Master: 13a30378f9bd4809a6c9bf519670c49c (127.12.159.193:45881)
I20260923 19:39:38.826267 28976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:40011
W20260923 19:39:39.134163 29165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:39.134456 29165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:39.134552 29165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:39.141877 29165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:39.142014 29165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:39.142131 29165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:39:39.152348 29165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:43687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=41727
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:39.153641 29165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:39.155001 29165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:39:39.168869 29171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:39.168883 29173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:39.168969 29170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:39.175433 29165 server_base.cc:1034] running on GCE node
I20260923 19:39:39.176254 29165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:39.177350 29165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:39.178578 29165 hybrid_clock.cc:648] HybridClock initialized: now 1790192379178526 us; error 41 us; skew 500 ppm
I20260923 19:39:39.178937 29165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:39 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192379, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:39.182659 29165 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:39:39.184252 29165 webserver.cc:460] Webserver started at http://127.12.159.194:41727/ using document root <none> and password file <none>
I20260923 19:39:39.185006 29165 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:39.185135 29165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:39.190903 29165 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:39:39.193888 29180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:39.195565 29165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:39:39.195765 29165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "ccf2fd8b8d5142328ac254df1ec44d8f"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "9bd21c314ba5a50e7ba6256391e4b37f"
server_key_iv: "388be604ff7e0aecdbf628fe496c4bcf"
server_key_version: "encryptionkey@0"
I20260923 19:39:39.196769 29165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:39.214159 29165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:39.219151 29165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:39.219480 29165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:39.220645 29165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:39:39.222496 29165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:39:39.222635 29165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:39.222779 29165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:39:39.222877 29165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:39.260627 29165 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:43687
I20260923 19:39:39.260685 29292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:43687 every 8 connection(s)
I20260923 19:39:39.262387 29165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:39:39.272619 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 29165
I20260923 19:39:39.273335 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:40349
--local_ip_for_outbound_sockets=127.12.159.195
--tserver_master_addrs=127.12.159.254:45231
--webserver_port=33979
--webserver_interface=127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:39:39 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192379, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:39:39.285167 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.265475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:52825 (local address 127.12.159.254:45231)
0923 19:39:39.265704 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.265711 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.266945 (+ 1234us) server_negotiation.cc:407] Connection header received
0923 19:39:39.269512 (+ 2567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.269517 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.269585 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.269678 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:39.271689 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.272435 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.274377 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.274841 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.274989 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.278643 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:39.278648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:39.278651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:39.278686 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:39.281420 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.282486 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.282491 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.282494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.282660 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.283233 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.283239 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.283242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.283651 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:39.283808 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:39.284530 (+ 722us) server_negotiation.cc:299] Negotiation successful
0923 19:39:39.284796 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:39:39.286378 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.265931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:52825)
0923 19:39:39.266724 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:39.266803 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:39.269173 (+ 2370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:39.269970 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:39.269982 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:39.270736 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:39:39.271505 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.271527 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.272617 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.272622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.274228 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.274241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.275081 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.275089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.275335 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.276056 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:39:39.276079 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:39:39.278353 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:39:39.281593 (+ 3240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:39.281603 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:39.281621 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:39.282314 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:39.282795 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:39.282801 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:39.282805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:39.283076 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:39.283773 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:39:39.283779 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:39:39.284156 (+ 377us) client_negotiation.cc:769] Sending connection context
0923 19:39:39.284429 (+ 273us) client_negotiation.cc:240] Negotiation successful
0923 19:39:39.284998 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":291,"threads_started":1}
I20260923 19:39:39.288028 29293 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45231
I20260923 19:39:39.288355 29293 heartbeater.cc:464] Registering TS with master...
I20260923 19:39:39.289093 29293 heartbeater.cc:511] Master 127.12.159.254:45231 requested a full tablet report, sending...
I20260923 19:39:39.290594 28976 ts_manager.cc:194] Registered new tserver with Master: ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687)
I20260923 19:39:39.291427 28976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:52825
W20260923 19:39:39.621272 29296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:39:39.621585 29296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:39:39.621691 29296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:39:39.630729 29296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:39:39.630854 29296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:39:39.630987 29296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:39:39.641824 29296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:40349
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=33979
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:39:39.643395 29296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:39:39.644825 29296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:39:39.658600 29304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:39.658639 29301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:39:39.658684 29302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:39:39.663316 29296 server_base.cc:1034] running on GCE node
I20260923 19:39:39.664006 29296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:39:39.665028 29296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:39:39.666285 29296 hybrid_clock.cc:648] HybridClock initialized: now 1790192379666218 us; error 40 us; skew 500 ppm
I20260923 19:39:39.666616 29296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:39:39 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192379, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:39:39.669731 29296 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:39:39.671197 29296 webserver.cc:460] Webserver started at http://127.12.159.195:33979/ using document root <none> and password file <none>
I20260923 19:39:39.671921 29296 fs_manager.cc:359] Metadata directory not provided
I20260923 19:39:39.672078 29296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:39:39.677520 29296 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:39:39.680296 29311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:39.681674 29296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:39:39.681900 29296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "7ee8621c654b4b5f8ed8c071146870c7"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "a01df33aea5daa272d6e0b620bfe3c94"
server_key_iv: "3fe83194f45982b5c097b7b46cc2d79a"
server_key_version: "encryptionkey@0"
I20260923 19:39:39.682948 29296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:39:39.704294 29296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:39:39.708575 29296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:39:39.708864 29296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:39:39.709954 29296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:39:39.711361 29296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:39:39.711481 29296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:39.711618 29296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:39:39.711705 29296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:39:39.745034 29296 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:40349
I20260923 19:39:39.745124 29423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:40349 every 8 connection(s)
I20260923 19:39:39.746603 29296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:39:39.754458 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 29296
Sep 23 19:39:39 dist-test-slave-lzv7 krb5kdc[28391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192379, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:39:39.769573 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.749213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:53645 (local address 127.12.159.254:45231)
0923 19:39:39.749425 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.749432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.750719 (+ 1287us) server_negotiation.cc:407] Connection header received
0923 19:39:39.752577 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.752581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.752650 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.752740 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:39.754320 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.755326 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.757296 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.758108 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.758243 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.762346 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:39.762351 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:39.762354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:39.762385 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:39.765733 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.766812 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.766816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.766818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.766989 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.767583 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.767587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.767589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.767875 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:39.767996 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:39.768940 (+ 944us) server_negotiation.cc:299] Negotiation successful
0923 19:39:39.769169 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:39:39.770725 29426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.749763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:53645)
0923 19:39:39.750565 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:39.750602 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:39.752323 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:39.752960 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:39.752968 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:39.753473 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:39:39.754148 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.754168 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.755537 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.755543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.757154 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.757166 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.758374 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.758380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.758604 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.759437 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:39:39.759466 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:39:39.762116 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:39:39.765943 (+ 3827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:39.765957 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:39.765986 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:39.766681 (+ 695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:39.767124 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:39:39.767129 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:39:39.767133 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:39:39.767454 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:39:39.768004 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:39:39.768013 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:39:39.768498 (+ 485us) client_negotiation.cc:769] Sending connection context
0923 19:39:39.768815 (+ 317us) client_negotiation.cc:240] Negotiation successful
0923 19:39:39.769230 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":312,"threads_started":1}
I20260923 19:39:39.771953 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.755464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45690 (local address 127.12.159.254:45231)
0923 19:39:39.755922 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.755940 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.756384 (+ 444us) server_negotiation.cc:407] Connection header received
0923 19:39:39.756569 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.756574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.756640 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.756748 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:39.758716 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.759446 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.760962 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.761578 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.761702 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.765306 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:39.765311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:39.765314 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:39.765360 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:39.768595 (+ 3235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.769465 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.769469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.769473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.769606 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.770224 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.770229 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.770232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.770572 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:39.770818 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:39.771498 (+ 680us) server_negotiation.cc:299] Negotiation successful
0923 19:39:39.771713 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":251,"threads_started":1}
I20260923 19:39:39.772212 29424 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45231
I20260923 19:39:39.772539 29424 heartbeater.cc:464] Registering TS with master...
I20260923 19:39:39.773319 29424 heartbeater.cc:511] Master 127.12.159.254:45231 requested a full tablet report, sending...
I20260923 19:39:39.774694 28976 ts_manager.cc:194] Registered new tserver with Master: 7ee8621c654b4b5f8ed8c071146870c7 (127.12.159.195:40349)
I20260923 19:39:39.775468 28976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:53645
I20260923 19:39:39.787156 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:39:39.795194 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.788259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45702 (local address 127.12.159.254:45231)
0923 19:39:39.788585 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.788593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.788961 (+ 368us) server_negotiation.cc:407] Connection header received
0923 19:39:39.789210 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.789220 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.789438 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.789601 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:39:39.790147 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.791283 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.792800 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.793492 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.793611 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.794226 (+ 615us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:39:39.794530 (+ 304us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0923 19:39:39.794903 (+ 373us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45702: token expired
Metrics: {"server-negotiator.queue_time_us":81}
W20260923 19:39:39.795346 29427 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45702: token expired
W20260923 19:39:39.795775 28897 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.159.254:45231)
I20260923 19:39:39.808753 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.796329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45706 (local address 127.12.159.254:45231)
0923 19:39:39.796474 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.796478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.796493 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:39:39.796548 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.796551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.796607 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.796686 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:39.798126 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.798839 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.800288 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.800712 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.800803 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.803541 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:39.803546 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:39.803549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:39.803583 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:39.806299 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.807052 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.807056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.807059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.807180 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:39.807541 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:39.807544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:39.807546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:39.807863 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:39.808045 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:39.808344 (+ 299us) server_negotiation.cc:299] Negotiation successful
0923 19:39:39.808515 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 19:39:39.812331 28976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:39:39.819803 28976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:39:39.830271 29161 heartbeater.cc:503] Master 127.12.159.254:45231 was elected leader, sending a full tablet report...
I20260923 19:39:39.861506 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.833728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50320 (local address 127.12.159.195:40349)
0923 19:39:39.852809 (+ 19081us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.852815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.852843 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:39:39.852924 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.852930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.853120 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.853336 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:39.854094 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.855899 (+ 1805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.858705 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.860191 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.860419 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.860637 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:39.860948 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 19:39:39.861120 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18160,"thread_start_us":18116,"threads_started":1}
I20260923 19:39:39.861552 29437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.833400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:40349 (local address 127.0.0.1:50320)
0923 19:39:39.851668 (+ 18268us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:39.851690 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:39.851809 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:39.853340 (+ 1531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:39.853348 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:39.853387 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:39.853840 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.853856 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.856069 (+ 2213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.856075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.858468 (+ 2393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.858486 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.860427 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.860433 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.860683 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.860746 (+ 63us) client_negotiation.cc:769] Sending connection context
0923 19:39:39.860883 (+ 137us) client_negotiation.cc:240] Negotiation successful
0923 19:39:39.861114 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18137,"mutex_wait_us":1,"thread_start_us":18013,"threads_started":1}
I20260923 19:39:39.862685 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.832536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43687 (local address 127.0.0.1:38974)
0923 19:39:39.849136 (+ 16600us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:39.849185 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:39.849379 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:39.855751 (+ 6372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:39.855756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:39.855780 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:39.856185 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.856201 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.857900 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.857905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.859737 (+ 1832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.859751 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.861765 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.861771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.862014 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.862063 (+ 49us) client_negotiation.cc:769] Sending connection context
0923 19:39:39.862139 (+ 76us) client_negotiation.cc:240] Negotiation successful
0923 19:39:39.862274 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16339,"mutex_wait_us":1,"thread_start_us":16191,"threads_started":1}
I20260923 19:39:39.862977 29436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.832899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42374)
0923 19:39:39.850023 (+ 17124us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:39.850046 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:39.850183 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:39.854604 (+ 4421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:39.854609 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:39.854634 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:39.855035 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.855046 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.856949 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.856954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.859726 (+ 2772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:39.859745 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.862116 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.862125 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:39.862280 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.862308 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 19:39:39.862398 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 19:39:39.862542 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16954,"mutex_wait_us":49,"thread_start_us":17357,"threads_started":1}
I20260923 19:39:39.863139 29439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.834485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42374 (local address 127.12.159.193:45881)
0923 19:39:39.854128 (+ 19643us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.854135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.854158 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:39:39.854231 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.854236 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.854426 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.854618 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:39.855287 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.856789 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.859930 (+ 3141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.861501 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.861719 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.861943 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:39.862477 (+ 534us) server_negotiation.cc:299] Negotiation successful
0923 19:39:39.862639 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19460,"thread_start_us":19271,"threads_started":1}
I20260923 19:39:39.863884 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:39.832727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38974 (local address 127.12.159.194:43687)
0923 19:39:39.855257 (+ 22530us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:39.855266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:39.855291 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:39:39.855370 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:39.855376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:39.855580 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:39.855761 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:39.856385 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.857714 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.860000 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:39.861501 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:39.863008 (+ 1507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:39.863361 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:39.863437 (+ 76us) server_negotiation.cc:299] Negotiation successful
0923 19:39:39.863609 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22337,"thread_start_us":22223,"threads_started":1}
I20260923 19:39:39.865886 29359 tablet_service.cc:1467] Processing CreateTablet for tablet d8d96a026ea441c4b565c690fc13b0b3 (DEFAULT_TABLE table=test-table [id=5334d0eda0fc4fd5baca883a4896c671]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:39:39.867094 29359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8d96a026ea441c4b565c690fc13b0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:39:39.866652 29096 tablet_service.cc:1467] Processing CreateTablet for tablet d8d96a026ea441c4b565c690fc13b0b3 (DEFAULT_TABLE table=test-table [id=5334d0eda0fc4fd5baca883a4896c671]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:39:39.867224 29228 tablet_service.cc:1467] Processing CreateTablet for tablet d8d96a026ea441c4b565c690fc13b0b3 (DEFAULT_TABLE table=test-table [id=5334d0eda0fc4fd5baca883a4896c671]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:39:39.868070 29096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8d96a026ea441c4b565c690fc13b0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:39:39.868530 29228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8d96a026ea441c4b565c690fc13b0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:39:39.880038 29440 tablet_bootstrap.cc:492] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Bootstrap starting.
I20260923 19:39:39.883473 29440 tablet_bootstrap.cc:654] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Neither blocks nor log segments found. Creating new log.
I20260923 19:39:39.883980 29441 tablet_bootstrap.cc:492] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Bootstrap starting.
I20260923 19:39:39.884934 29440 log.cc:824] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:39.888032 29441 tablet_bootstrap.cc:654] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Neither blocks nor log segments found. Creating new log.
I20260923 19:39:39.888459 29440 tablet_bootstrap.cc:492] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: No bootstrap required, opened a new log
I20260923 19:39:39.888778 29440 ts_tablet_manager.cc:1397] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260923 19:39:39.889344 29441 log.cc:824] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:39.886454 29442 tablet_bootstrap.cc:492] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Bootstrap starting.
I20260923 19:39:39.893069 29442 tablet_bootstrap.cc:654] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Neither blocks nor log segments found. Creating new log.
I20260923 19:39:39.893072 29441 tablet_bootstrap.cc:492] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: No bootstrap required, opened a new log
I20260923 19:39:39.893370 29441 ts_tablet_manager.cc:1397] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260923 19:39:39.894205 29442 log.cc:824] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:39:39.896652 29442 tablet_bootstrap.cc:492] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: No bootstrap required, opened a new log
I20260923 19:39:39.896909 29442 ts_tablet_manager.cc:1397] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260923 19:39:39.899828 29440 raft_consensus.cc:348] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:39.900306 29440 raft_consensus.cc:374] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:39:39.900452 29440 raft_consensus.cc:729] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee8621c654b4b5f8ed8c071146870c7, State: Initialized, Role: FOLLOWER
I20260923 19:39:39.901114 29440 consensus_queue.cc:260] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:39.902266 29424 heartbeater.cc:503] Master 127.12.159.254:45231 was elected leader, sending a full tablet report...
I20260923 19:39:39.902930 29440 ts_tablet_manager.cc:1428] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260923 19:39:39.905350 29442 raft_consensus.cc:348] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:39.905314 29441 raft_consensus.cc:348] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:39.905740 29442 raft_consensus.cc:374] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:39:39.905844 29441 raft_consensus.cc:374] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:39:39.905876 29442 raft_consensus.cc:729] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf2fd8b8d5142328ac254df1ec44d8f, State: Initialized, Role: FOLLOWER
I20260923 19:39:39.905965 29441 raft_consensus.cc:729] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13a30378f9bd4809a6c9bf519670c49c, State: Initialized, Role: FOLLOWER
I20260923 19:39:39.906558 29442 consensus_queue.cc:260] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:39.906713 29441 consensus_queue.cc:260] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:39.908623 29441 ts_tablet_manager.cc:1428] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
I20260923 19:39:39.909950 29293 heartbeater.cc:503] Master 127.12.159.254:45231 was elected leader, sending a full tablet report...
I20260923 19:39:39.910724 29442 ts_tablet_manager.cc:1428] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Time spent starting tablet: real 0.014s user 0.008s sys 0.006s
W20260923 19:39:39.998232 29425 tablet.cc:2369] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:39:40.015209 29294 tablet.cc:2369] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:39:40.044195 29162 tablet.cc:2369] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:39:40.127431 29448 raft_consensus.cc:482] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:39:40.127707 29448 raft_consensus.cc:504] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:40.129715 29448 leader_election.cc:288] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687), 7ee8621c654b4b5f8ed8c071146870c7 (127.12.159.195:40349)
I20260923 19:39:40.136993 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.130359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:35847 (local address 127.12.159.195:40349)
0923 19:39:40.130653 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:40.130659 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:40.131029 (+ 370us) server_negotiation.cc:407] Connection header received
0923 19:39:40.131284 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:40.131287 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:40.131349 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:40.131466 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:40.132081 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.132895 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.134945 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.135991 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.136172 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.136252 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:40.136581 (+ 329us) server_negotiation.cc:299] Negotiation successful
0923 19:39:40.136707 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260923 19:39:40.137003 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.130349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:58391 (local address 127.12.159.194:43687)
0923 19:39:40.130635 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:40.130642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:40.131369 (+ 727us) server_negotiation.cc:407] Connection header received
0923 19:39:40.131557 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:40.131561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:40.131619 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:40.131713 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:39:40.132256 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.132970 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.135046 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.135994 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.136198 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.136282 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:40.136600 (+ 318us) server_negotiation.cc:299] Negotiation successful
0923 19:39:40.136723 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260923 19:39:40.137245 29449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.130009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:40349 (local address 127.12.159.193:35847)
0923 19:39:40.130883 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.130908 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:40.131141 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:40.131491 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:40.131495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:40.131524 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:40.131930 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:40.131947 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.133041 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.133046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:40.134789 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:40.134805 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.136223 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.136231 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:40.136400 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.136450 (+ 50us) client_negotiation.cc:769] Sending connection context
0923 19:39:40.136554 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 19:39:40.136703 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":25,"thread_start_us":543,"threads_started":1}
I20260923 19:39:40.137283 29450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.130173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:43687 (local address 127.12.159.193:58391)
0923 19:39:40.131264 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.131282 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:39:40.131414 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:39:40.131736 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:39:40.131741 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:39:40.131769 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:39:40.132114 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:40.132122 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.133106 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.133111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:40.134852 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:39:40.134866 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.136271 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.136277 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:39:40.136450 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.136473 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:39:40.136574 (+ 101us) client_negotiation.cc:240] Negotiation successful
0923 19:39:40.136704 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"mutex_wait_us":27,"thread_start_us":798,"threads_started":1}
I20260923 19:39:40.138303 29248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8d96a026ea441c4b565c690fc13b0b3" candidate_uuid: "13a30378f9bd4809a6c9bf519670c49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" is_pre_election: true
I20260923 19:39:40.138453 29379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8d96a026ea441c4b565c690fc13b0b3" candidate_uuid: "13a30378f9bd4809a6c9bf519670c49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee8621c654b4b5f8ed8c071146870c7" is_pre_election: true
I20260923 19:39:40.138834 29248 raft_consensus.cc:2454] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13a30378f9bd4809a6c9bf519670c49c in term 0.
I20260923 19:39:40.138934 29379 raft_consensus.cc:2454] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13a30378f9bd4809a6c9bf519670c49c in term 0.
I20260923 19:39:40.139495 29051 leader_election.cc:302] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13a30378f9bd4809a6c9bf519670c49c, ccf2fd8b8d5142328ac254df1ec44d8f; no voters:
I20260923 19:39:40.139890 29448 raft_consensus.cc:2781] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:39:40.140051 29448 raft_consensus.cc:482] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:39:40.140159 29448 raft_consensus.cc:3037] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:39:40.142385 29448 raft_consensus.cc:504] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:40.143002 29448 leader_election.cc:288] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [CANDIDATE]: Term 1 election: Requested vote from peers ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687), 7ee8621c654b4b5f8ed8c071146870c7 (127.12.159.195:40349)
I20260923 19:39:40.143409 29248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8d96a026ea441c4b565c690fc13b0b3" candidate_uuid: "13a30378f9bd4809a6c9bf519670c49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f"
I20260923 19:39:40.143502 29379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8d96a026ea441c4b565c690fc13b0b3" candidate_uuid: "13a30378f9bd4809a6c9bf519670c49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee8621c654b4b5f8ed8c071146870c7"
I20260923 19:39:40.143642 29248 raft_consensus.cc:3037] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:39:40.143697 29379 raft_consensus.cc:3037] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:39:40.146966 29248 raft_consensus.cc:2454] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13a30378f9bd4809a6c9bf519670c49c in term 1.
I20260923 19:39:40.146972 29379 raft_consensus.cc:2454] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13a30378f9bd4809a6c9bf519670c49c in term 1.
I20260923 19:39:40.147377 29051 leader_election.cc:302] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 13a30378f9bd4809a6c9bf519670c49c, 7ee8621c654b4b5f8ed8c071146870c7, ccf2fd8b8d5142328ac254df1ec44d8f; no voters:
I20260923 19:39:40.147719 29448 raft_consensus.cc:2781] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:39:40.148149 29448 raft_consensus.cc:686] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 1 LEADER]: Becoming Leader. State: Replica: 13a30378f9bd4809a6c9bf519670c49c, State: Running, Role: LEADER
I20260923 19:39:40.148741 29448 consensus_queue.cc:237] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } }
I20260923 19:39:40.153146 28976 catalog_manager.cc:5495] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c reported cstate change: term changed from 0 to 1, leader changed from <none> to 13a30378f9bd4809a6c9bf519670c49c (127.12.159.193). New cstate: current_term: 1 leader_uuid: "13a30378f9bd4809a6c9bf519670c49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13a30378f9bd4809a6c9bf519670c49c" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 45881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 } health_report { overall_health: UNKNOWN } } }
I20260923 19:39:40.219435 29439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.213701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.12.159.193:45881)
0923 19:39:40.213976 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:40.213983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:40.214096 (+ 113us) server_negotiation.cc:407] Connection header received
0923 19:39:40.214384 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:40.214388 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:40.214472 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:40.214640 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:39:40.215009 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.215775 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.217187 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.217601 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.217735 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.218307 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:39:40.218861 (+ 554us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:39:40.219030 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:40.219082 (+ 52us) server_negotiation.cc:299] Negotiation successful
0923 19:39:40.219164 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260923 19:39:40.227926 29248 raft_consensus.cc:1261] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Refusing update from remote peer 13a30378f9bd4809a6c9bf519670c49c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:39:40.227954 29379 raft_consensus.cc:1261] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 FOLLOWER]: Refusing update from remote peer 13a30378f9bd4809a6c9bf519670c49c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:39:40.229040 29451 consensus_queue.cc:1035] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee8621c654b4b5f8ed8c071146870c7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:39:40.229444 29448 consensus_queue.cc:1035] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccf2fd8b8d5142328ac254df1ec44d8f" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:39:40.258265 28975 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:39:40.258589 28975 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:39:40.262153 28975 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Sending DeleteTablet for 3 replicas of tablet d8d96a026ea441c4b565c690fc13b0b3
I20260923 19:39:40.263335 29228 tablet_service.cc:1514] Processing DeleteTablet for tablet d8d96a026ea441c4b565c690fc13b0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:39:40 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:38974
I20260923 19:39:40.263530 29359 tablet_service.cc:1514] Processing DeleteTablet for tablet d8d96a026ea441c4b565c690fc13b0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:39:40 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:50320
I20260923 19:39:40.266743 29096 tablet_service.cc:1514] Processing DeleteTablet for tablet d8d96a026ea441c4b565c690fc13b0b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:39:40 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:42374
I20260923 19:39:40.268393 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 29013
I20260923 19:39:40.283880 29466 tablet_replica.cc:330] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: stopping tablet replica
I20260923 19:39:40.286518 29466 raft_consensus.cc:2229] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:39:40.287694 29466 raft_consensus.cc:2258] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:39:40.296156 29465 tablet_replica.cc:330] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: stopping tablet replica
I20260923 19:39:40.296756 29465 raft_consensus.cc:2229] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:39:40.297389 29465 raft_consensus.cc:2258] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:39:40.299933 29465 ts_tablet_manager.cc:1905] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:39:40.305735 29466 ts_tablet_manager.cc:1905] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:39:40.310489 29465 ts_tablet_manager.cc:1918] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:39:40.311034 29465 log.cc:1196] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/d8d96a026ea441c4b565c690fc13b0b3
I20260923 19:39:40.311784 29465 ts_tablet_manager.cc:1939] T d8d96a026ea441c4b565c690fc13b0b3 P 7ee8621c654b4b5f8ed8c071146870c7: Deleting consensus metadata
I20260923 19:39:40.314838 28960 catalog_manager.cc:4841] TS 7ee8621c654b4b5f8ed8c071146870c7 (127.12.159.195:40349): tablet d8d96a026ea441c4b565c690fc13b0b3 (table test-table [id=5334d0eda0fc4fd5baca883a4896c671]) successfully deleted
I20260923 19:39:40.323001 29464 tablet_replica.cc:330] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: stopping tablet replica
I20260923 19:39:40.324493 29439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.269485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42380 (local address 127.12.159.193:45881)
0923 19:39:40.270497 (+ 1012us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:40.270506 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:40.270529 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:39:40.270600 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:40.270609 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:40.270707 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:40.270851 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:40.274051 (+ 3200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.275715 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.278647 (+ 2932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.279670 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.279854 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.289866 (+ 10012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:40.289889 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:40.289914 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:40.289979 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:40.295348 (+ 5369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:40.315327 (+ 19979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:40.315348 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:40.315355 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:40.315617 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:40.322511 (+ 6894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:40.322521 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:40.322525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:40.323092 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:40.323444 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:40.323837 (+ 393us) server_negotiation.cc:299] Negotiation successful
0923 19:39:40.324113 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":839}
I20260923 19:39:40.324828 29464 raft_consensus.cc:2229] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:39:40.325439 29464 raft_consensus.cc:2258] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:39:40.326670 29156 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:40.328579 29464 ts_tablet_manager.cc:1905] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:39:40.336238 29464 ts_tablet_manager.cc:1918] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:39:40.336443 29464 log.cc:1196] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/d8d96a026ea441c4b565c690fc13b0b3
I20260923 19:39:40.337018 29464 ts_tablet_manager.cc:1939] T d8d96a026ea441c4b565c690fc13b0b3 P ccf2fd8b8d5142328ac254df1ec44d8f: Deleting consensus metadata
I20260923 19:39:40.339214 28962 catalog_manager.cc:4841] TS ccf2fd8b8d5142328ac254df1ec44d8f (127.12.159.194:43687): tablet d8d96a026ea441c4b565c690fc13b0b3 (table test-table [id=5334d0eda0fc4fd5baca883a4896c671]) successfully deleted
I20260923 19:39:40.432585 29466 ts_tablet_manager.cc:1918] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:39:40.432927 29466 log.cc:1196] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/d8d96a026ea441c4b565c690fc13b0b3
I20260923 19:39:40.433596 29466 ts_tablet_manager.cc:1939] T d8d96a026ea441c4b565c690fc13b0b3 P 13a30378f9bd4809a6c9bf519670c49c: Deleting consensus metadata
I20260923 19:39:40.433982 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 29013
W20260923 19:39:40.452720 28961 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.159.193:45881 (error 108)
I20260923 19:39:40.453007 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 29165
I20260923 19:39:40.455070 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.454243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42390)
0923 19:39:40.454723 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.454885 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":226,"threads_started":1}
W20260923 19:39:40.455376 28961 catalog_manager.cc:4584] TS 13a30378f9bd4809a6c9bf519670c49c (127.12.159.193:45881): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d8d96a026ea441c4b565c690fc13b0b3: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
I20260923 19:39:40.472433 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.453891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38976 (local address 127.12.159.194:43687)
0923 19:39:40.454086 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:40.454091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:40.454137 (+ 46us) server_negotiation.cc:407] Connection header received
0923 19:39:40.454405 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:40.454415 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:40.454538 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:40.454678 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:40.456193 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.457015 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.458460 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.459053 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.459171 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.466348 (+ 7177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:40.466365 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:40.466382 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:40.466423 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:40.469557 (+ 3134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:40.470360 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:40.470369 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:40.470372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:40.470534 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:40.470908 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:40.470911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:40.470913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:40.471335 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:40.471564 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:40.471812 (+ 248us) server_negotiation.cc:299] Negotiation successful
0923 19:39:40.471995 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:39:40.473098 29288 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:40.508944 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.508412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42404)
0923 19:39:40.508654 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.508768 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260923 19:39:40.510028 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.509598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42416)
0923 19:39:40.509745 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.509862 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260923 19:39:40.571246 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.570206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42430)
0923 19:39:40.570452 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.570889 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260923 19:39:40.572530 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 29165
I20260923 19:39:40.572721 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.572288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42438)
0923 19:39:40.572431 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.572526 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260923 19:39:40.590377 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 29296
I20260923 19:39:40.604848 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.591199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50336 (local address 127.12.159.195:40349)
0923 19:39:40.591397 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:39:40.591402 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:39:40.591423 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:39:40.591565 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:39:40.591570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:39:40.591639 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:39:40.591733 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:39:40.593653 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.594486 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.595697 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:39:40.596098 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:39:40.596205 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:39:40.599241 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:39:40.599256 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:39:40.599272 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:39:40.599311 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:39:40.602333 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:40.602951 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:40.602958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:40.602960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:40.603086 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:39:40.603447 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:39:40.603450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:39:40.603452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:39:40.603809 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:39:40.604034 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0923 19:39:40.604320 (+ 286us) server_negotiation.cc:299] Negotiation successful
0923 19:39:40.604499 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:39:40.605536 29419 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:40.655552 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.654962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42452)
0923 19:39:40.655287 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.655406 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161}
I20260923 19:39:40.656745 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.656282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42460)
0923 19:39:40.656520 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.656605 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260923 19:39:40.697237 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 29296
I20260923 19:39:40.713893 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 28943
I20260923 19:39:40.715338 29006 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:39:40.830794 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:39:40.830045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:45881 (local address 127.0.0.1:42468)
0923 19:39:40.830385 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0923 19:39:40.830519 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260923 19:39:40.831372 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 28943
I20260923 19:40:00.853394 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45231
--webserver_interface=127.12.159.254
--webserver_port=33837
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:01.187592 29473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:01.187958 29473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:01.188136 29473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:01.195536 29473 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 19:40:01.195679 29473 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 19:40:01.195760 29473 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 19:40:01.195859 29473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:01.195940 29473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:01.196040 29473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:01.196130 29473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:01.196213 29473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:01.206305 29473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=33837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:01.207695 29473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:01.209057 29473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:01.222177 29478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:01.222235 29479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:01.222162 29481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:01.222543 29473 server_base.cc:1034] running on GCE node
I20260923 19:40:01.223702 29473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:01.225250 29473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:01.226541 29473 hybrid_clock.cc:648] HybridClock initialized: now 1790192401226469 us; error 45 us; skew 500 ppm
I20260923 19:40:01.227005 29473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:01 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192401, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:01.230384 29473 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:40:01.231906 29473 webserver.cc:460] Webserver started at http://127.12.159.254:33837/ using document root <none> and password file <none>
I20260923 19:40:01.232656 29473 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:01.232798 29473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:01.238508 29473 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:40:01.241439 29488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:01.242990 29473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:40:01.243194 29473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "28eeab82de0749c4acea7bc433d04960"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "c7343b02c94e1ea6a8cd4400df1e5945"
server_key_iv: "b850c296f85d109865a4346db33009b8"
server_key_version: "encryptionkey@0"
I20260923 19:40:01.244242 29473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:01.259575 29473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:01.263969 29473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:01.264276 29473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:01.284291 29473 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45231
I20260923 19:40:01.284394 29539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45231 every 8 connection(s)
I20260923 19:40:01.286067 29473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:01.287652 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 29473
I20260923 19:40:01.288770 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:45881
--local_ip_for_outbound_sockets=127.12.159.193
--tserver_master_addrs=127.12.159.254:45231
--webserver_port=36411
--webserver_interface=127.12.159.193
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:40:01.296701 29540 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:40:01.300645 29540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Bootstrap starting.
I20260923 19:40:01.322021 29540 log.cc:824] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:01.338413 29540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:40:01.339003 29540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Bootstrap complete.
I20260923 19:40:01.348474 29540 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:40:01.349428 29540 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28eeab82de0749c4acea7bc433d04960, State: Initialized, Role: FOLLOWER
I20260923 19:40:01.350073 29540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:40:01.350320 29540 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:01.350458 29540 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:01.350638 29540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:40:01.354597 29540 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:40:01.355120 29540 leader_election.cc:302] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28eeab82de0749c4acea7bc433d04960; no voters:
I20260923 19:40:01.355876 29540 leader_election.cc:288] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 19:40:01.356027 29544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 19:40:01.357262 29544 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [term 3 LEADER]: Becoming Leader. State: Replica: 28eeab82de0749c4acea7bc433d04960, State: Running, Role: LEADER
I20260923 19:40:01.357959 29544 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } }
I20260923 19:40:01.358233 29540 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:01.360868 29546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28eeab82de0749c4acea7bc433d04960. Latest consensus state: current_term: 3 leader_uuid: "28eeab82de0749c4acea7bc433d04960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } } }
I20260923 19:40:01.361330 29546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:01.362144 29545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "28eeab82de0749c4acea7bc433d04960" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28eeab82de0749c4acea7bc433d04960" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45231 } } }
I20260923 19:40:01.362516 29545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:01.365494 29550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:01.374635 29550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:01.376292 29550 catalog_manager.cc:1259] Loaded cluster ID: 302fb7403b164078a380c9d8f22bd0b3
I20260923 19:40:01.376502 29550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:01.381253 29550 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:01.382992 29550 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Loaded TSK: 0
I20260923 19:40:01.383255 29550 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 28eeab82de0749c4acea7bc433d04960: Loaded TSK: 1
F20260923 19:40:01.384449 29550 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f936338b9ad google::LogMessage::Fail() at ??:0
@ 0x7f936338e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f936338b4de google::LogMessage::Flush() at ??:0
@ 0x7f936338ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f93670ef7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f93670de73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f9378dc01c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f9378dbf783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f9378e4b2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f9378e4b0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f9378e955e9 std::function<>::operator()() at ??:0
@ 0x7f9378dc3cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f9378dc1c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9378e49610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9378e49439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9365fd7345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9365fda91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9365fda799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9365fb5eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f936928f6db start_thread at ??:0
@ 0x7f936222561f clone at ??:0
W20260923 19:40:01.726748 29542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:01.727039 29542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:01.727135 29542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:01.734565 29542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:01.734683 29542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:01.734803 29542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:40:01.744923 29542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:45881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=36411
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:01.746343 29542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:01.747622 29542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:01.761111 29590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:01.761200 29587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:01.761188 29588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:01.762049 29542 server_base.cc:1034] running on GCE node
I20260923 19:40:01.762696 29542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:01.763698 29542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:01.764952 29542 hybrid_clock.cc:648] HybridClock initialized: now 1790192401764889 us; error 56 us; skew 500 ppm
I20260923 19:40:01.765317 29542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:01 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192401, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:01.768649 29542 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:40:01.770295 29542 webserver.cc:460] Webserver started at http://127.12.159.193:36411/ using document root <none> and password file <none>
I20260923 19:40:01.771034 29542 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:01.771196 29542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:01.776789 29542 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:40:01.779614 29597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:01.781075 29542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:40:01.781282 29542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "13a30378f9bd4809a6c9bf519670c49c"
format_stamp: "Formatted at 2026-09-23 19:39:15 on dist-test-slave-lzv7"
server_key: "3b39a5a341b8f2259b51b71547c160e7"
server_key_iv: "5f206d924fc1f625e84b8edf509338a5"
server_key_version: "encryptionkey@0"
I20260923 19:40:01.782449 29542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:01.803160 29542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:01.807812 29542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:01.808139 29542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:01.809257 29542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:01.810760 29542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:01.810911 29542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:01.811054 29542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:01.811144 29542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:01.846777 29542 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:45881
I20260923 19:40:01.846832 29709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:45881 every 8 connection(s)
I20260923 19:40:01.848325 29542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:40:01.853538 29712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:01.851517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:57905)
0923 19:40:01.852310 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:01.852568 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":298,"threads_started":1}
W20260923 19:40:01.854454 29710 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:45231 (0 consecutive failures): Network error: Failed to ping master at 127.12.159.254:45231: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
I20260923 19:40:01.855389 29712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:01.855011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:41823)
0923 19:40:01.855177 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:01.855263 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260923 19:40:01.856570 29712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:01.856157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:54893)
0923 19:40:01.856341 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:01.856425 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 19:40:01.856879 29710 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:40:01.858063 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 29542
I20260923 19:40:01.858692 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:43687
--local_ip_for_outbound_sockets=127.12.159.194
--tserver_master_addrs=127.12.159.254:45231
--webserver_port=41727
--webserver_interface=127.12.159.194
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:02.200037 29713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:02.200341 29713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:02.200503 29713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:02.208017 29713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:02.208148 29713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:02.208357 29713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:40:02.218564 29713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:43687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=41727
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:02.219918 29713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:02.221268 29713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:02.234980 29718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:02.235040 29719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:02.235062 29721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:02.235980 29713 server_base.cc:1034] running on GCE node
I20260923 19:40:02.236624 29713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:02.237596 29713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:02.238858 29713 hybrid_clock.cc:648] HybridClock initialized: now 1790192402238805 us; error 48 us; skew 500 ppm
I20260923 19:40:02.239298 29713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:02 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192402, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:02.247991 29713 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:40:02.249679 29713 webserver.cc:460] Webserver started at http://127.12.159.194:41727/ using document root <none> and password file <none>
I20260923 19:40:02.250475 29713 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:02.250634 29713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:02.256392 29713 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:40:02.259351 29728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:02.260747 29713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:40:02.260957 29713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "ccf2fd8b8d5142328ac254df1ec44d8f"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "9bd21c314ba5a50e7ba6256391e4b37f"
server_key_iv: "388be604ff7e0aecdbf628fe496c4bcf"
server_key_version: "encryptionkey@0"
I20260923 19:40:02.262048 29713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:02.291383 29713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:02.295889 29713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:02.296175 29713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:02.297152 29713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:02.298622 29713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:02.298748 29713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:02.298875 29713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:02.298961 29713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:02.333123 29713 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:43687
I20260923 19:40:02.333182 29840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:43687 every 8 connection(s)
I20260923 19:40:02.334668 29713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:40:02.339478 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:02.337580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:52253)
0923 19:40:02.338327 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:02.338559 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":295,"threads_started":1}
W20260923 19:40:02.340106 29841 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:45231 (0 consecutive failures): Network error: Failed to ping master at 127.12.159.254:45231: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
I20260923 19:40:02.340919 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:02.340621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:34731)
0923 19:40:02.340756 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:02.340820 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 19:40:02.341800 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:02.341502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:59459)
0923 19:40:02.341617 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:02.341685 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 19:40:02.342129 29841 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:40:02.344396 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 29713
I20260923 19:40:02.345007 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:40349
--local_ip_for_outbound_sockets=127.12.159.195
--tserver_master_addrs=127.12.159.254:45231
--webserver_port=33979
--webserver_interface=127.12.159.195
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:02.691074 29844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:02.691375 29844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:02.691473 29844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:02.704005 29844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:02.704201 29844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:02.704452 29844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:40:02.715873 29844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:40349
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=33979
--tserver_master_addrs=127.12.159.254:45231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:02.717245 29844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:02.718688 29844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:02.733870 29849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:02.733824 29852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:02.733896 29850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:02.735113 29844 server_base.cc:1034] running on GCE node
I20260923 19:40:02.735869 29844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:02.736971 29844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:02.738274 29844 hybrid_clock.cc:648] HybridClock initialized: now 1790192402738194 us; error 76 us; skew 500 ppm
I20260923 19:40:02.738708 29844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:02 dist-test-slave-lzv7 krb5kdc[28391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192402, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:02.742457 29844 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:40:02.744333 29844 webserver.cc:460] Webserver started at http://127.12.159.195:33979/ using document root <none> and password file <none>
I20260923 19:40:02.745182 29844 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:02.745370 29844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:02.751847 29844 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:40:02.755100 29859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:02.756667 29844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:40:02.756836 29844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "7ee8621c654b4b5f8ed8c071146870c7"
format_stamp: "Formatted at 2026-09-23 19:39:16 on dist-test-slave-lzv7"
server_key: "a01df33aea5daa272d6e0b620bfe3c94"
server_key_iv: "3fe83194f45982b5c097b7b46cc2d79a"
server_key_version: "encryptionkey@0"
I20260923 19:40:02.757907 29844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:02.777426 29844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:02.781658 29844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:02.781987 29844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:02.782956 29844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:02.784265 29844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:02.784358 29844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:02.784451 29844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:02.784510 29844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:02.819941 29844 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:40349
I20260923 19:40:02.820036 29971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:40349 every 8 connection(s)
I20260923 19:40:02.821456 29844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:40:02.826805 29974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:02.824636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:50031)
0923 19:40:02.825435 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:02.825690 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":293,"threads_started":1}
W20260923 19:40:02.827651 29972 heartbeater.cc:644] Failed to heartbeat to 127.12.159.254:45231 (0 consecutive failures): Network error: Failed to ping master at 127.12.159.254:45231: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
I20260923 19:40:02.828527 29974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:02.828188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:51461)
0923 19:40:02.828342 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:02.828418 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260923 19:40:02.829457 29974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:02.829049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:42313)
0923 19:40:02.829207 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:02.829335 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260923 19:40:02.829780 29972 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:40:02.830305 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 29844
I20260923 19:40:02.858783 29976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:02.857694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:38463)
0923 19:40:02.858353 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:02.858485 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":327,"threads_started":1}
I20260923 19:40:03.343448 29977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:03.342639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:53047)
0923 19:40:03.343121 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:03.343213 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":238,"threads_started":1}
I20260923 19:40:03.831408 29978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:03.830538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:55051)
0923 19:40:03.831034 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:03.831158 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":241,"threads_started":1}
I20260923 19:40:03.860850 29979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:03.859926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:35281)
0923 19:40:03.860568 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:03.860652 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":405,"threads_started":1}
I20260923 19:40:04.345625 29980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:04.344564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:59677)
0923 19:40:04.345253 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:04.345375 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":342,"threads_started":1}
I20260923 19:40:04.833042 29981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:04.832343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:50649)
0923 19:40:04.832789 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:04.832872 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":213,"threads_started":1}
I20260923 19:40:04.862645 29982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:04.861873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:42161)
0923 19:40:04.862387 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:04.862474 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":282,"threads_started":1}
I20260923 19:40:05.347384 29983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:05.346621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:35957)
0923 19:40:05.347109 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:05.347186 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":266,"threads_started":1}
I20260923 19:40:05.834911 29984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:05.834125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:37065)
0923 19:40:05.834626 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:05.834720 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":265,"threads_started":1}
I20260923 19:40:05.864758 29985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:05.863854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:52465)
0923 19:40:05.864441 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:05.864557 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":272,"threads_started":1}
I20260923 19:40:06.349062 29986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:06.348221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:60293)
0923 19:40:06.348787 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:06.348875 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":248,"threads_started":1}
I20260923 19:40:06.836649 29987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:06.835897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:54155)
0923 19:40:06.836390 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:06.836476 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":237,"threads_started":1}
I20260923 19:40:06.866634 29988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:06.865765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:47975)
0923 19:40:06.866321 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:06.866420 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":294,"threads_started":1}
I20260923 19:40:07.350829 29989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:07.350124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:58473)
0923 19:40:07.350574 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:07.350652 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":215,"threads_started":1}
I20260923 19:40:07.838368 29990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:07.837595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:54293)
0923 19:40:07.838103 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:07.838186 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":288,"threads_started":1}
I20260923 19:40:07.868427 29991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:07.867662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:45849)
0923 19:40:07.868147 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:07.868259 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":251,"threads_started":1}
I20260923 19:40:08.352663 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:08.351850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:33105)
0923 19:40:08.352401 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:08.352500 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":294,"threads_started":1}
I20260923 19:40:08.840023 29993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:08.839270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:37491)
0923 19:40:08.839766 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:08.839858 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":270,"threads_started":1}
I20260923 19:40:08.870443 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:08.869479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:33761)
0923 19:40:08.870122 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:08.870211 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":344,"threads_started":1}
I20260923 19:40:09.354663 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:09.353767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:46747)
0923 19:40:09.354358 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:09.354447 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":232,"threads_started":1}
I20260923 19:40:09.841892 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:09.840995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:33743)
0923 19:40:09.841552 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:09.841643 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":233,"threads_started":1}
I20260923 19:40:09.872361 29997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:09.871498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:50007)
0923 19:40:09.872073 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:09.872180 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":295,"threads_started":1}
I20260923 19:40:10.356352 29998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:10.355565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:44295)
0923 19:40:10.356018 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:10.356151 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":239,"threads_started":1}
I20260923 19:40:10.843582 29999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:10.842818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:33035)
0923 19:40:10.843314 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:10.843409 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":234,"threads_started":1}
I20260923 19:40:10.874060 30000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:10.873269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:50127)
0923 19:40:10.873725 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:10.873863 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":216,"threads_started":1}
I20260923 19:40:11.358191 30001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:11.357363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:55929)
0923 19:40:11.357927 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:11.358014 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":239,"threads_started":1}
I20260923 19:40:11.845315 30002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:11.844549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:58603)
0923 19:40:11.845043 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:11.845139 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":237,"threads_started":1}
I20260923 19:40:11.876013 30003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:11.875108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:56597)
0923 19:40:11.875691 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:11.875785 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":307,"threads_started":1}
I20260923 19:40:12.359922 30004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:12.359159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:57039)
0923 19:40:12.359664 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:12.359757 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":287,"threads_started":1}
I20260923 19:40:12.847071 30005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:12.846391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:48207)
0923 19:40:12.846836 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:12.846914 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":239,"threads_started":1}
I20260923 19:40:12.878057 30006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:12.877026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:60007)
0923 19:40:12.877631 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:12.877777 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":330,"threads_started":1}
I20260923 19:40:13.361685 30007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:13.360930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:47065)
0923 19:40:13.361390 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:13.361492 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":241,"threads_started":1}
I20260923 19:40:13.848862 30008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:13.848058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:56291)
0923 19:40:13.848585 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:13.848691 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":285,"threads_started":1}
I20260923 19:40:13.879789 30009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:13.879079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:35051)
0923 19:40:13.879523 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:13.879608 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":238,"threads_started":1}
I20260923 19:40:14.363508 30010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:14.362763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:40327)
0923 19:40:14.363247 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:14.363338 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":240,"threads_started":1}
I20260923 19:40:14.850785 30011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:14.850026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:56189)
0923 19:40:14.850551 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:14.850638 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":296,"threads_started":1}
I20260923 19:40:14.881927 30012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:14.880846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:42259)
0923 19:40:14.881397 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:14.881633 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":317,"threads_started":1}
I20260923 19:40:15.365388 30013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:15.364495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:59375)
0923 19:40:15.365071 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:15.365184 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":258,"threads_started":1}
I20260923 19:40:15.852762 30014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:15.851907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:47071)
0923 19:40:15.852480 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:15.852580 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":327,"threads_started":1}
I20260923 19:40:15.883750 30015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:15.882922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:48237)
0923 19:40:15.883454 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:15.883546 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":287,"threads_started":1}
I20260923 19:40:16.367201 30016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:16.366433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:35593)
0923 19:40:16.366904 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:16.366990 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":215,"threads_started":1}
I20260923 19:40:16.854579 30017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:16.853766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:50843)
0923 19:40:16.854312 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:16.854406 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":248,"threads_started":1}
I20260923 19:40:16.885681 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:16.884927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:52577)
0923 19:40:16.885395 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:16.885492 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":261,"threads_started":1}
I20260923 19:40:17.369516 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:17.368556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.194:45457)
0923 19:40:17.369114 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:17.369278 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":275,"threads_started":1}
I20260923 19:40:17.835079 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 29542
I20260923 19:40:17.856684 30020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:17.836668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52640 (local address 127.12.159.193:45881)
0923 19:40:17.837246 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:17.837261 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:17.837302 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:40:17.839075 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:17.839085 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:17.839569 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:17.840122 (+ 553us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:17.841766 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:17.843293 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:17.845070 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:17.845857 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:17.846029 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:17.848885 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:17.848896 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:17.848922 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:17.848977 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:17.852843 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:17.853604 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:17.853612 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:17.853620 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:17.853919 (+ 299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:17.854302 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:17.854306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:17.854308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:17.854911 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:17.855157 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:17.855860 (+ 703us) server_negotiation.cc:299] Negotiation successful
0923 19:40:17.856389 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":271,"threads_started":1}
I20260923 19:40:17.856685 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:17.855921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.195:53697)
0923 19:40:17.856418 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:17.856513 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":260,"threads_started":1}
I20260923 19:40:17.858453 29705 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:17.948619 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 29542
I20260923 19:40:17.948716 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:17.947493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45231 (local address 127.12.159.193:37931)
0923 19:40:17.948118 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:17.948371 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.254:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":284,"threads_started":1}
I20260923 19:40:17.963598 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 29713
I20260923 19:40:17.982697 30024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:17.964620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57102 (local address 127.12.159.194:43687)
0923 19:40:17.965260 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:17.965274 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:17.965318 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:40:17.967104 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:17.967114 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:17.967544 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:17.967907 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:17.969474 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:17.970893 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:17.972215 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:17.972983 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:17.973228 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:17.975973 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:17.975982 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:17.975998 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:17.976038 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:17.979058 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:17.979808 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:17.979816 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:17.979824 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:17.980000 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:17.980402 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:17.980409 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:17.980413 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:17.980975 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:17.981324 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:17.982003 (+ 679us) server_negotiation.cc:299] Negotiation successful
0923 19:40:17.982413 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":274,"threads_started":1}
I20260923 19:40:17.984112 29836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:18.070604 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 29713
I20260923 19:40:18.088413 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 29844
I20260923 19:40:18.107386 30026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:18.089448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59514 (local address 127.12.159.195:40349)
0923 19:40:18.090152 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:18.090167 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:18.090210 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:40:18.091869 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:18.091879 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:18.092323 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:18.092712 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:18.094391 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:18.095624 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:18.096885 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:18.097584 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:18.097789 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:18.100630 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:18.100639 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:18.100656 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:18.100697 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:18.103655 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:18.104410 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:18.104417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:18.104424 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:18.104608 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:18.105022 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:18.105028 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:18.105031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:18.105601 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:18.105933 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:18.106639 (+ 706us) server_negotiation.cc:299] Negotiation successful
0923 19:40:18.107077 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":356,"threads_started":1}
I20260923 19:40:18.108887 29967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:18.196493 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 29844
2026-09-23T19:40:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64707 ms)
[----------] 30 tests from SecurityITest (300346 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:18 dist-test-slave-lzv7 krb5kdc[30030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:18 dist-test-slave-lzv7 krb5kdc[30030](info): set up 2 sockets
Sep 23 19:40:18 dist-test-slave-lzv7 krb5kdc[30030](info): commencing operation
krb5kdc: starting...
W20260923 19:40:19.322329 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.008s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:19 dist-test-slave-lzv7 krb5kdc[30030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:40:19.589538 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41705
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:46225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:41705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:19.926599 30043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:19.926966 30043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:19.927145 30043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:19.934644 30043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:19.934751 30043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:19.934862 30043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:19.934981 30043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:19.935071 30043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:19.945148 30043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:46225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:41705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:19.946623 30043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:19.947956 30043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:19.960438 30048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:19.960528 30049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:19.960547 30051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:19.960789 30043 server_base.cc:1034] running on GCE node
I20260923 19:40:19.961987 30043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:19.963614 30043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:19.964864 30043 hybrid_clock.cc:648] HybridClock initialized: now 1790192419964810 us; error 46 us; skew 500 ppm
I20260923 19:40:19.965220 30043 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:19 dist-test-slave-lzv7 krb5kdc[30030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192419, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:19.968348 30043 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:40:19.969965 30043 webserver.cc:460] Webserver started at http://127.12.159.254:38941/ using document root <none> and password file <none>
I20260923 19:40:19.970711 30043 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:19.970813 30043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:19.971050 30043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:19.974144 30043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "fe5e5f1416c845f1a572e7fa279c5e85"
format_stamp: "Formatted at 2026-09-23 19:40:19 on dist-test-slave-lzv7"
server_key: "df1b2f80284ec440e858c09fc1b97c03"
server_key_iv: "0d2851b6f37d090f28445a9ac2fe08c9"
server_key_version: "encryptionkey@0"
I20260923 19:40:19.974844 30043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "fe5e5f1416c845f1a572e7fa279c5e85"
format_stamp: "Formatted at 2026-09-23 19:40:19 on dist-test-slave-lzv7"
server_key: "df1b2f80284ec440e858c09fc1b97c03"
server_key_iv: "0d2851b6f37d090f28445a9ac2fe08c9"
server_key_version: "encryptionkey@0"
I20260923 19:40:19.979986 30043 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:40:19.983474 30058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:19.984838 30043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:40:19.984977 30043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "fe5e5f1416c845f1a572e7fa279c5e85"
format_stamp: "Formatted at 2026-09-23 19:40:19 on dist-test-slave-lzv7"
server_key: "df1b2f80284ec440e858c09fc1b97c03"
server_key_iv: "0d2851b6f37d090f28445a9ac2fe08c9"
server_key_version: "encryptionkey@0"
I20260923 19:40:19.985142 30043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:20.016849 30043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:20.021442 30043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:20.021704 30043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:20.042398 30043 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:41705
I20260923 19:40:20.042436 30109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:41705 every 8 connection(s)
I20260923 19:40:20.043892 30043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:20.044513 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30043
I20260923 19:40:20.044750 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:20.045594 12927 external_mini_cluster.cc:1428] Setting key f53105aa0264ee6ac272eab5eb935629
I20260923 19:40:20.048393 30110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:40:20 dist-test-slave-lzv7 krb5kdc[30030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:20.062309 30110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85: Bootstrap starting.
I20260923 19:40:20.066864 30110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:20.068130 30110 log.cc:824] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:20.071614 30113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:20.047760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38958 (local address 127.12.159.254:41705)
0923 19:40:20.048573 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:20.048585 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:20.048628 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:40:20.050379 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:20.050401 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:20.050810 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:20.051152 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:20.053025 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:20.054499 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:20.056437 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:20.057125 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:20.057258 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:20.062481 (+ 5223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:20.062494 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:20.062514 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:20.062568 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:20.066645 (+ 4077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:20.067470 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:20.067479 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:20.067487 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:20.067708 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:20.068122 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:20.068128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:20.068131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:20.068899 (+ 768us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:20.069127 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:20.069839 (+ 712us) server_negotiation.cc:299] Negotiation successful
0923 19:40:20.070285 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":349,"threads_started":1}
I20260923 19:40:20.071656 30110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85: No bootstrap required, opened a new log
I20260923 19:40:20.079941 30110 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41705 } }
I20260923 19:40:20.080299 30110 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:20.080374 30110 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe5e5f1416c845f1a572e7fa279c5e85, State: Initialized, Role: FOLLOWER
I20260923 19:40:20.080848 30110 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41705 } }
I20260923 19:40:20.081069 30110 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:20.081172 30110 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:20.081295 30110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:20.083575 30110 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41705 } }
I20260923 19:40:20.084188 30110 leader_election.cc:302] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe5e5f1416c845f1a572e7fa279c5e85; no voters:
I20260923 19:40:20.084764 30110 leader_election.cc:288] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:20.084904 30115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:20.085623 30115 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [term 1 LEADER]: Becoming Leader. State: Replica: fe5e5f1416c845f1a572e7fa279c5e85, State: Running, Role: LEADER
I20260923 19:40:20.086220 30115 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41705 } }
I20260923 19:40:20.086943 30110 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:20.088994 30116 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41705 } } }
I20260923 19:40:20.089383 30116 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:20.090165 30117 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5e5f1416c845f1a572e7fa279c5e85. Latest consensus state: current_term: 1 leader_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe5e5f1416c845f1a572e7fa279c5e85" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41705 } } }
I20260923 19:40:20.090518 30117 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:20.092566 30121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:20.098122 30121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:20.107908 30121 catalog_manager.cc:1347] Generated new cluster ID: 61cd16481681419dbf3e3f699f2cbfdd
I20260923 19:40:20.108035 30121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:20.120393 30121 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:20.121914 30121 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:20.133599 30121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85: Generated new TSK 0
I20260923 19:40:20.134519 30121 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:40:20.198899 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41705
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:46225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:20.540330 30136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:20.540689 30136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:20.540866 30136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:20.548877 30136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:20.549057 30136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:20.549230 30136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:40:20.559186 30136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:46225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:20.560568 30136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:20.561977 30136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:20.575130 30141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:20.575258 30142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:20.575279 30144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:20.576370 30136 server_base.cc:1034] running on GCE node
I20260923 19:40:20.577003 30136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:20.578052 30136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:20.579263 30136 hybrid_clock.cc:648] HybridClock initialized: now 1790192420579216 us; error 34 us; skew 500 ppm
I20260923 19:40:20.579607 30136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:20 dist-test-slave-lzv7 krb5kdc[30030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192420, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:20.583101 30136 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:40:20.585590 30136 webserver.cc:460] Webserver started at http://127.12.159.193:40399/ using document root <none> and password file <none>
I20260923 19:40:20.586371 30136 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:20.586529 30136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:20.586876 30136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:20.590219 30136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "41d969b52d8342d69d7428fc00bb9f66"
format_stamp: "Formatted at 2026-09-23 19:40:20 on dist-test-slave-lzv7"
server_key: "aab4dbb573515a992ed3d797316bce9e"
server_key_iv: "4822b982f82da4fb3013bbb3a82de97c"
server_key_version: "encryptionkey@0"
I20260923 19:40:20.591023 30136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "41d969b52d8342d69d7428fc00bb9f66"
format_stamp: "Formatted at 2026-09-23 19:40:20 on dist-test-slave-lzv7"
server_key: "aab4dbb573515a992ed3d797316bce9e"
server_key_iv: "4822b982f82da4fb3013bbb3a82de97c"
server_key_version: "encryptionkey@0"
I20260923 19:40:20.596451 30136 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:40:20.600302 30151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:20.601613 30136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:40:20.601872 30136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "41d969b52d8342d69d7428fc00bb9f66"
format_stamp: "Formatted at 2026-09-23 19:40:20 on dist-test-slave-lzv7"
server_key: "aab4dbb573515a992ed3d797316bce9e"
server_key_iv: "4822b982f82da4fb3013bbb3a82de97c"
server_key_version: "encryptionkey@0"
I20260923 19:40:20.602138 30136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:20.628268 30136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:20.632617 30136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:20.632920 30136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:20.633951 30136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:20.635272 30136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:20.635345 30136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:20.635429 30136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:20.635483 30136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:20.669399 30136 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:40765
I20260923 19:40:20.669480 30263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:40765 every 8 connection(s)
I20260923 19:40:20.670768 30136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:40:20.677019 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30136
I20260923 19:40:20.677251 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:40:20.678169 12927 external_mini_cluster.cc:1428] Setting key 809ef19f597b70b304f9fdbd1b41e4b4
Sep 23 19:40:20 dist-test-slave-lzv7 krb5kdc[30030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192420, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:20.692171 30266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:20.673514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:49277 (local address 127.12.159.254:41705)
0923 19:40:20.674015 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:20.674019 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:20.674910 (+ 891us) server_negotiation.cc:407] Connection header received
0923 19:40:20.676962 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:20.676967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:20.677050 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:20.677195 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:20.679266 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:20.679998 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:20.681571 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:20.682056 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:20.682195 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:20.685715 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:20.685720 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:20.685723 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:20.685755 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:20.688885 (+ 3130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:20.689671 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:20.689676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:20.689678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:20.689794 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:20.690300 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:20.690308 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:20.690311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:20.690611 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:20.690776 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:20.691517 (+ 741us) server_negotiation.cc:299] Negotiation successful
0923 19:40:20.691755 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":264,"threads_started":1}
I20260923 19:40:20.693226 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:20.674032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41705 (local address 127.12.159.193:49277)
0923 19:40:20.674741 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:20.674779 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:20.676619 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:20.677487 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:20.677501 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:20.678357 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:20.679071 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:20.679089 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:20.680177 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:20.680181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:20.681399 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:20.681415 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:20.682291 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:20.682299 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:20.682535 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:20.683269 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:20.683292 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:20.685468 (+ 2176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:20.689053 (+ 3585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:20.689064 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:20.689081 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:20.689518 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:20.689965 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:20.689970 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:20.689974 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:20.690179 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:20.690763 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:20.690771 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:20.691113 (+ 342us) client_negotiation.cc:769] Sending connection context
0923 19:40:20.691408 (+ 295us) client_negotiation.cc:240] Negotiation successful
0923 19:40:20.691958 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":276,"threads_started":1}
I20260923 19:40:20.694959 30264 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41705
I20260923 19:40:20.695290 30264 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:20.696017 30264 heartbeater.cc:511] Master 127.12.159.254:41705 requested a full tablet report, sending...
I20260923 19:40:20.698278 30075 ts_manager.cc:194] Registered new tserver with Master: 41d969b52d8342d69d7428fc00bb9f66 (127.12.159.193:40765)
I20260923 19:40:20.699790 30075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:49277
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:40:20.740784 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41705
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:46225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:21.077910 30270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:21.078223 30270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:21.078320 30270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:21.085798 30270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:21.085981 30270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:21.086118 30270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:40:21.096568 30270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:46225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:21.097843 30270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:21.099231 30270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:21.112898 30275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:21.112844 30276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:21.112793 30278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:21.113729 30270 server_base.cc:1034] running on GCE node
I20260923 19:40:21.114398 30270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:21.115296 30270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:21.116564 30270 hybrid_clock.cc:648] HybridClock initialized: now 1790192421116518 us; error 56 us; skew 500 ppm
I20260923 19:40:21.116937 30270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:21 dist-test-slave-lzv7 krb5kdc[30030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192421, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:21.120464 30270 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:40:21.122123 30270 webserver.cc:460] Webserver started at http://127.12.159.194:39463/ using document root <none> and password file <none>
I20260923 19:40:21.122843 30270 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:21.122993 30270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:21.123320 30270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:21.126513 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "434e83442f504edd81f867d3fecbc151"
format_stamp: "Formatted at 2026-09-23 19:40:21 on dist-test-slave-lzv7"
server_key: "879cfb1fa98bfbcf3965a63056f0cb55"
server_key_iv: "618d59de1b487c572eaf8995b8f43b4c"
server_key_version: "encryptionkey@0"
I20260923 19:40:21.127302 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "434e83442f504edd81f867d3fecbc151"
format_stamp: "Formatted at 2026-09-23 19:40:21 on dist-test-slave-lzv7"
server_key: "879cfb1fa98bfbcf3965a63056f0cb55"
server_key_iv: "618d59de1b487c572eaf8995b8f43b4c"
server_key_version: "encryptionkey@0"
I20260923 19:40:21.132972 30270 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260923 19:40:21.136858 30285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:21.138362 30270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:40:21.138554 30270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "434e83442f504edd81f867d3fecbc151"
format_stamp: "Formatted at 2026-09-23 19:40:21 on dist-test-slave-lzv7"
server_key: "879cfb1fa98bfbcf3965a63056f0cb55"
server_key_iv: "618d59de1b487c572eaf8995b8f43b4c"
server_key_version: "encryptionkey@0"
I20260923 19:40:21.138784 30270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:21.157260 30270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:21.161444 30270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:21.161774 30270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:21.162798 30270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:21.164194 30270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:21.164302 30270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:21.164461 30270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:21.164541 30270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:21.199718 30270 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:45377
I20260923 19:40:21.199779 30397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:45377 every 8 connection(s)
I20260923 19:40:21.201049 30270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:40:21.205914 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30270
I20260923 19:40:21.206127 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:40:21.206574 12927 external_mini_cluster.cc:1428] Setting key adb6d13583a1d1e5134f8c1a7cdae17f
Sep 23 19:40:21 dist-test-slave-lzv7 krb5kdc[30030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192421, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:21.223660 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.203686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:56253 (local address 127.12.159.254:41705)
0923 19:40:21.204177 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.204182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.204981 (+ 799us) server_negotiation.cc:407] Connection header received
0923 19:40:21.207262 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.207269 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.207369 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.207492 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:21.209458 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.210736 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.212300 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.213045 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.213190 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.217081 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:21.217087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:21.217090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:21.217127 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:21.219963 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:21.221074 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:21.221078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:21.221080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:21.221210 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:21.221737 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:21.221740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:21.221742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:21.222094 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:21.222214 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.223193 (+ 979us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.223381 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":237,"threads_started":1}
I20260923 19:40:21.225250 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.204122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41705 (local address 127.12.159.194:56253)
0923 19:40:21.204812 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:21.204850 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:21.206966 (+ 2116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:21.207818 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:21.207829 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:21.208641 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:21.209274 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.209292 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.210880 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.210884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.212144 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.212157 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.213264 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.213268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.213472 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.214288 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:21.214315 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:21.216803 (+ 2488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:21.220168 (+ 3365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:21.220181 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:21.220206 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:21.220943 (+ 737us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:21.221333 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:21.221341 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:21.221347 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:21.221610 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:21.222223 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:21.222235 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:21.222756 (+ 521us) client_negotiation.cc:769] Sending connection context
0923 19:40:21.223100 (+ 344us) client_negotiation.cc:240] Negotiation successful
0923 19:40:21.223727 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":274,"threads_started":1}
I20260923 19:40:21.226930 30398 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41705
I20260923 19:40:21.227294 30398 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:21.228124 30398 heartbeater.cc:511] Master 127.12.159.254:41705 requested a full tablet report, sending...
I20260923 19:40:21.229671 30075 ts_manager.cc:194] Registered new tserver with Master: 434e83442f504edd81f867d3fecbc151 (127.12.159.194:45377)
I20260923 19:40:21.230571 30075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:56253
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:40:21.266410 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41705
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:46225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:21.608727 30404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:21.609081 30404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:21.609253 30404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:21.616694 30404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:21.616868 30404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:21.617069 30404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:40:21.626875 30404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:46225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:41705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:21.628315 30404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:21.629621 30404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:21.643337 30412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:21.643589 30409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:21.643443 30410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:21.644681 30404 server_base.cc:1034] running on GCE node
I20260923 19:40:21.645404 30404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:21.646551 30404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:21.647794 30404 hybrid_clock.cc:648] HybridClock initialized: now 1790192421647746 us; error 44 us; skew 500 ppm
I20260923 19:40:21.648137 30404 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:21 dist-test-slave-lzv7 krb5kdc[30030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192421, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:21.651356 30404 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:40:21.652863 30404 webserver.cc:460] Webserver started at http://127.12.159.195:41069/ using document root <none> and password file <none>
I20260923 19:40:21.653632 30404 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:21.653787 30404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:21.654153 30404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:21.657184 30404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "43fddc4969dc41c2bdc0359b60ab025d"
format_stamp: "Formatted at 2026-09-23 19:40:21 on dist-test-slave-lzv7"
server_key: "7b9e17249f9997dc075b452b2ca91f16"
server_key_iv: "ed863b07e5baaffc7a35402bd4fb02be"
server_key_version: "encryptionkey@0"
I20260923 19:40:21.658118 30404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "43fddc4969dc41c2bdc0359b60ab025d"
format_stamp: "Formatted at 2026-09-23 19:40:21 on dist-test-slave-lzv7"
server_key: "7b9e17249f9997dc075b452b2ca91f16"
server_key_iv: "ed863b07e5baaffc7a35402bd4fb02be"
server_key_version: "encryptionkey@0"
I20260923 19:40:21.663667 30404 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:40:21.667414 30419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:21.668944 30404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:40:21.669183 30404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "43fddc4969dc41c2bdc0359b60ab025d"
format_stamp: "Formatted at 2026-09-23 19:40:21 on dist-test-slave-lzv7"
server_key: "7b9e17249f9997dc075b452b2ca91f16"
server_key_iv: "ed863b07e5baaffc7a35402bd4fb02be"
server_key_version: "encryptionkey@0"
I20260923 19:40:21.669425 30404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:21.691154 30404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:21.695952 30404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:21.696278 30404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:21.697396 30404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:21.698880 30404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:21.698998 30404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:21.699172 30404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:21.699255 30404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:21.703012 30264 heartbeater.cc:503] Master 127.12.159.254:41705 was elected leader, sending a full tablet report...
I20260923 19:40:21.735167 30404 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:44033
I20260923 19:40:21.735211 30531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:44033 every 8 connection(s)
I20260923 19:40:21.736698 30404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:40:21.742138 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30404
I20260923 19:40:21.742317 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:40:21.742913 12927 external_mini_cluster.cc:1428] Setting key 51b43d0eb5b3bdf62d716f010683353c
Sep 23 19:40:21 dist-test-slave-lzv7 krb5kdc[30030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192421, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:21.757366 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.739409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:53599 (local address 127.12.159.254:41705)
0923 19:40:21.739870 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.739874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.740658 (+ 784us) server_negotiation.cc:407] Connection header received
0923 19:40:21.743094 (+ 2436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.743102 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.743199 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.743297 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:21.745192 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.746171 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.747714 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.748090 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.748185 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.751735 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:21.751741 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:21.751744 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:21.751778 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:21.754327 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:21.755089 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:21.755093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:21.755095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:21.755235 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:21.755604 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:21.755606 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:21.755608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:21.755862 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:21.755981 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.756718 (+ 737us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.756958 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":248,"threads_started":1}
I20260923 19:40:21.758553 30535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.739804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:41705 (local address 127.12.159.195:53599)
0923 19:40:21.740496 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:21.740537 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:21.742707 (+ 2170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:21.743580 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:21.743588 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:21.744245 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:21.744994 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.745014 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.746314 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.746317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.747568 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.747581 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.748278 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.748283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.748478 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.749118 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:21.749150 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:21.751519 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:21.754466 (+ 2947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:21.754473 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:21.754487 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:21.754981 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:21.755332 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:21.755335 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:21.755337 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:21.755511 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:21.755976 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:21.755981 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:21.756318 (+ 337us) client_negotiation.cc:769] Sending connection context
0923 19:40:21.756606 (+ 288us) client_negotiation.cc:240] Negotiation successful
0923 19:40:21.757184 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":272,"threads_started":1}
I20260923 19:40:21.759999 30532 heartbeater.cc:347] Connected to a master server at 127.12.159.254:41705
I20260923 19:40:21.760298 30532 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:21.761018 30532 heartbeater.cc:511] Master 127.12.159.254:41705 requested a full tablet report, sending...
I20260923 19:40:21.762629 30075 ts_manager.cc:194] Registered new tserver with Master: 43fddc4969dc41c2bdc0359b60ab025d (127.12.159.195:44033)
I20260923 19:40:21.763600 30075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:53599
I20260923 19:40:21.771406 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:40:21.789948 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.776415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38962 (local address 127.12.159.254:41705)
0923 19:40:21.776676 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.776684 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.776969 (+ 285us) server_negotiation.cc:407] Connection header received
0923 19:40:21.777236 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.777246 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.777312 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.777421 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:21.779013 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.779739 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.781089 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.781483 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.781639 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.784341 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:21.784347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:21.784351 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:21.784387 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:21.786952 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:21.787805 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:21.787815 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:21.787818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:21.787937 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:21.788358 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:21.788365 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:21.788373 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:21.788719 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:21.788972 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.789329 (+ 357us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.789577 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260923 19:40:21.794461 30075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:40:21.801275 30075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:40:21.827293 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.814170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:44033 (local address 127.0.0.1:47910)
0923 19:40:21.814939 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:21.814988 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:21.815167 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:21.816367 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:21.816378 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:21.816431 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:21.816899 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.816915 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.819613 (+ 2698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.819622 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.822724 (+ 3102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.822744 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.825819 (+ 3075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.825829 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.826157 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.826241 (+ 84us) client_negotiation.cc:769] Sending connection context
0923 19:40:21.826422 (+ 181us) client_negotiation.cc:240] Negotiation successful
0923 19:40:21.826728 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":308,"threads_started":1}
I20260923 19:40:21.828833 30546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.814398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47910 (local address 127.12.159.195:44033)
0923 19:40:21.815241 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.815250 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.815288 (+ 38us) server_negotiation.cc:407] Connection header received
0923 19:40:21.815395 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.815407 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.815729 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.815968 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:21.817201 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.819391 (+ 2190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.822987 (+ 3596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.825096 (+ 2109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.825358 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.825600 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.828061 (+ 2461us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.828345 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":430,"threads_started":1}
I20260923 19:40:21.834908 30467 tablet_service.cc:1467] Processing CreateTablet for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 (DEFAULT_TABLE table=test-table [id=05ac345db79342a2be37ccdd88b108b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:21.836689 30467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:21.838321 30547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.815633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:40765 (local address 127.0.0.1:57480)
0923 19:40:21.829676 (+ 14043us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:21.829696 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:21.829960 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:21.830988 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:21.830992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:21.831023 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:21.831377 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.831388 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.833333 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.833337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.835300 (+ 1963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.835312 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.837455 (+ 2143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.837462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.837658 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.837702 (+ 44us) client_negotiation.cc:769] Sending connection context
0923 19:40:21.837792 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 19:40:21.837950 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13917,"thread_start_us":15280,"threads_started":1}
I20260923 19:40:21.838941 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.816314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57480 (local address 127.12.159.193:40765)
0923 19:40:21.822711 (+ 6397us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.822721 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.829844 (+ 7123us) server_negotiation.cc:407] Connection header received
0923 19:40:21.830173 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.830184 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.830500 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.830693 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:21.831554 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.833175 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.835463 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.837039 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.837249 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.837435 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.838434 (+ 999us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.838601 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6183,"thread_start_us":6029,"threads_started":1}
I20260923 19:40:21.839309 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.815279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:45377 (local address 127.0.0.1:52938)
0923 19:40:21.827663 (+ 12384us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:21.827690 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:21.827838 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:21.832333 (+ 4495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:21.832338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:21.832363 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:21.832591 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.832601 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.834921 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.834928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.836749 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.836767 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.838591 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.838597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.838783 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.838830 (+ 47us) client_negotiation.cc:769] Sending connection context
0923 19:40:21.838900 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 19:40:21.839047 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12241,"thread_start_us":14136,"threads_started":1}
I20260923 19:40:21.839949 30549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.815694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52938 (local address 127.12.159.194:45377)
0923 19:40:21.831808 (+ 16114us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.831818 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.831849 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:40:21.831945 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.831959 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.832143 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.832351 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:21.832993 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.834730 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.836942 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.838378 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.839290 (+ 912us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.839449 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.839510 (+ 61us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.839676 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15950,"thread_start_us":15857,"threads_started":1}
I20260923 19:40:21.842960 30199 tablet_service.cc:1467] Processing CreateTablet for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 (DEFAULT_TABLE table=test-table [id=05ac345db79342a2be37ccdd88b108b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:21.843379 30333 tablet_service.cc:1467] Processing CreateTablet for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 (DEFAULT_TABLE table=test-table [id=05ac345db79342a2be37ccdd88b108b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:21.844590 30199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:21.844626 30333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:21.852213 30551 tablet_bootstrap.cc:492] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Bootstrap starting.
I20260923 19:40:21.856725 30551 tablet_bootstrap.cc:654] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:21.857558 30552 tablet_bootstrap.cc:492] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Bootstrap starting.
I20260923 19:40:21.858338 30551 log.cc:824] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:21.862861 30552 tablet_bootstrap.cc:654] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:21.863480 30553 tablet_bootstrap.cc:492] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Bootstrap starting.
I20260923 19:40:21.864521 30552 log.cc:824] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:21.867496 30553 tablet_bootstrap.cc:654] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:21.867530 30551 tablet_bootstrap.cc:492] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: No bootstrap required, opened a new log
I20260923 19:40:21.867869 30551 ts_tablet_manager.cc:1397] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260923 19:40:21.868008 30552 tablet_bootstrap.cc:492] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: No bootstrap required, opened a new log
I20260923 19:40:21.868289 30552 ts_tablet_manager.cc:1397] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260923 19:40:21.868834 30553 log.cc:824] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:21.871992 30553 tablet_bootstrap.cc:492] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: No bootstrap required, opened a new log
I20260923 19:40:21.872327 30553 ts_tablet_manager.cc:1397] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:40:21.877451 30551 raft_consensus.cc:348] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.877952 30551 raft_consensus.cc:374] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:21.878096 30551 raft_consensus.cc:729] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43fddc4969dc41c2bdc0359b60ab025d, State: Initialized, Role: FOLLOWER
I20260923 19:40:21.878827 30551 consensus_queue.cc:260] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.878927 30552 raft_consensus.cc:348] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.879446 30552 raft_consensus.cc:374] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:21.879586 30552 raft_consensus.cc:729] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434e83442f504edd81f867d3fecbc151, State: Initialized, Role: FOLLOWER
I20260923 19:40:21.880064 30532 heartbeater.cc:503] Master 127.12.159.254:41705 was elected leader, sending a full tablet report...
I20260923 19:40:21.880340 30552 consensus_queue.cc:260] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.880757 30551 ts_tablet_manager.cc:1428] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260923 19:40:21.882296 30398 heartbeater.cc:503] Master 127.12.159.254:41705 was elected leader, sending a full tablet report...
I20260923 19:40:21.882974 30552 ts_tablet_manager.cc:1428] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260923 19:40:21.883872 30553 raft_consensus.cc:348] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.884357 30553 raft_consensus.cc:374] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:21.884501 30553 raft_consensus.cc:729] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d969b52d8342d69d7428fc00bb9f66, State: Initialized, Role: FOLLOWER
I20260923 19:40:21.885183 30553 consensus_queue.cc:260] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.888491 30553 ts_tablet_manager.cc:1428] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260923 19:40:21.914711 30559 raft_consensus.cc:482] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:40:21.915095 30559 raft_consensus.cc:504] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.916865 30559 leader_election.cc:288] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43fddc4969dc41c2bdc0359b60ab025d (127.12.159.195:44033), 434e83442f504edd81f867d3fecbc151 (127.12.159.194:45377)
W20260923 19:40:21.923210 30265 tablet.cc:2369] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:40:21.923596 30546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.917359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:38303 (local address 127.12.159.195:44033)
0923 19:40:21.917580 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.917585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.918171 (+ 586us) server_negotiation.cc:407] Connection header received
0923 19:40:21.918401 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.918408 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.918492 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.918600 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:21.919215 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.919969 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.921824 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.922613 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.922796 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.922875 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.923192 (+ 317us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.923323 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:40:21.923715 30560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.917278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:44033 (local address 127.12.159.193:38303)
0923 19:40:21.918050 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:21.918071 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:21.918213 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:21.918691 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:21.918695 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:21.918728 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:21.919054 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.919064 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.920169 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.920177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.921624 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.921636 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.922827 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.922834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.923014 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.923045 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:40:21.923157 (+ 112us) client_negotiation.cc:240] Negotiation successful
0923 19:40:21.923306 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":416,"threads_started":1}
I20260923 19:40:21.924314 30549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.918532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:51939 (local address 127.12.159.194:45377)
0923 19:40:21.918818 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.918825 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.918926 (+ 101us) server_negotiation.cc:407] Connection header received
0923 19:40:21.919145 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.919154 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.919211 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.919305 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:21.919838 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.920525 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.922291 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.923087 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.923257 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.923321 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.923941 (+ 620us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.924079 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260923 19:40:21.924340 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.918164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:45377 (local address 127.12.159.193:51939)
0923 19:40:21.918805 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:21.918823 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:21.918996 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:21.919332 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:21.919336 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:21.919359 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:21.919688 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.919696 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.920668 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.920673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.922139 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:21.922152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.923495 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.923500 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:21.923700 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.923737 (+ 37us) client_negotiation.cc:769] Sending connection context
0923 19:40:21.923906 (+ 169us) client_negotiation.cc:240] Negotiation successful
0923 19:40:21.924026 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":345,"threads_started":1}
I20260923 19:40:21.925158 30487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a06b8b6e7704ef3afdb5f1fd234f0c7" candidate_uuid: "41d969b52d8342d69d7428fc00bb9f66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43fddc4969dc41c2bdc0359b60ab025d" is_pre_election: true
I20260923 19:40:21.925324 30353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a06b8b6e7704ef3afdb5f1fd234f0c7" candidate_uuid: "41d969b52d8342d69d7428fc00bb9f66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434e83442f504edd81f867d3fecbc151" is_pre_election: true
I20260923 19:40:21.925724 30487 raft_consensus.cc:2454] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d969b52d8342d69d7428fc00bb9f66 in term 0.
I20260923 19:40:21.925871 30353 raft_consensus.cc:2454] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d969b52d8342d69d7428fc00bb9f66 in term 0.
I20260923 19:40:21.926546 30155 leader_election.cc:302] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d969b52d8342d69d7428fc00bb9f66, 43fddc4969dc41c2bdc0359b60ab025d; no voters:
I20260923 19:40:21.926959 30559 raft_consensus.cc:2781] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:40:21.927114 30559 raft_consensus.cc:482] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:40:21.927223 30559 raft_consensus.cc:3037] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:21.929380 30559 raft_consensus.cc:504] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.930038 30559 leader_election.cc:288] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [CANDIDATE]: Term 1 election: Requested vote from peers 43fddc4969dc41c2bdc0359b60ab025d (127.12.159.195:44033), 434e83442f504edd81f867d3fecbc151 (127.12.159.194:45377)
I20260923 19:40:21.930583 30353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a06b8b6e7704ef3afdb5f1fd234f0c7" candidate_uuid: "41d969b52d8342d69d7428fc00bb9f66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434e83442f504edd81f867d3fecbc151"
I20260923 19:40:21.930559 30487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a06b8b6e7704ef3afdb5f1fd234f0c7" candidate_uuid: "41d969b52d8342d69d7428fc00bb9f66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43fddc4969dc41c2bdc0359b60ab025d"
I20260923 19:40:21.930812 30353 raft_consensus.cc:3037] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:21.930804 30487 raft_consensus.cc:3037] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:21.933460 30353 raft_consensus.cc:2454] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d969b52d8342d69d7428fc00bb9f66 in term 1.
I20260923 19:40:21.933462 30487 raft_consensus.cc:2454] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d969b52d8342d69d7428fc00bb9f66 in term 1.
I20260923 19:40:21.933888 30155 leader_election.cc:302] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d969b52d8342d69d7428fc00bb9f66, 43fddc4969dc41c2bdc0359b60ab025d; no voters:
I20260923 19:40:21.934191 30559 raft_consensus.cc:2781] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:21.934649 30559 raft_consensus.cc:686] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 1 LEADER]: Becoming Leader. State: Replica: 41d969b52d8342d69d7428fc00bb9f66, State: Running, Role: LEADER
I20260923 19:40:21.935137 30559 consensus_queue.cc:237] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } }
I20260923 19:40:21.940495 30075 catalog_manager.cc:5495] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41d969b52d8342d69d7428fc00bb9f66 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "41d969b52d8342d69d7428fc00bb9f66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41d969b52d8342d69d7428fc00bb9f66" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 40765 } health_report { overall_health: HEALTHY } } }
W20260923 19:40:21.953245 30399 tablet.cc:2369] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:40:21.969347 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:21.963687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.12.159.193:40765)
0923 19:40:21.963920 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:21.963924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:21.963944 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:40:21.964035 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:21.964038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:21.964155 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:21.964288 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:40:21.964669 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.965405 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.966999 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:21.967430 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:21.967529 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:21.968064 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:40:21.968674 (+ 610us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:40:21.968788 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:21.968920 (+ 132us) server_negotiation.cc:299] Negotiation successful
0923 19:40:21.968991 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260923 19:40:21.978470 30487 raft_consensus.cc:1261] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 1 FOLLOWER]: Refusing update from remote peer 41d969b52d8342d69d7428fc00bb9f66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:21.978472 30353 raft_consensus.cc:1261] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 1 FOLLOWER]: Refusing update from remote peer 41d969b52d8342d69d7428fc00bb9f66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:21.979494 30559 consensus_queue.cc:1035] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "434e83442f504edd81f867d3fecbc151" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 45377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:21.979898 30562 consensus_queue.cc:1035] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43fddc4969dc41c2bdc0359b60ab025d" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 44033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:40:21.988265 30533 tablet.cc:2369] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:40:22.006474 30074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:22.006800 30074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:22.011184 30074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe5e5f1416c845f1a572e7fa279c5e85: Sending DeleteTablet for 3 replicas of tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7
I20260923 19:40:22.012651 30199 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:22 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:57480
I20260923 19:40:22.012670 30333 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:22 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:52938
I20260923 19:40:22.012902 30467 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:22 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:47910
I20260923 19:40:22.015332 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30136
I20260923 19:40:22.023638 30576 tablet_replica.cc:330] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: stopping tablet replica
I20260923 19:40:22.024636 30576 raft_consensus.cc:2229] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:22.025400 30576 raft_consensus.cc:2258] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:22.026677 30575 tablet_replica.cc:330] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: stopping tablet replica
I20260923 19:40:22.027385 30575 raft_consensus.cc:2229] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:40:22.030014 30576 ts_tablet_manager.cc:1905] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:22.035189 30575 raft_consensus.cc:2258] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66 [term 1 FOLLOWER]: Raft consensus is shut down!
Sep 23 19:40:22 dist-test-slave-lzv7 krb5kdc[30030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:40:22.041358 30575 ts_tablet_manager.cc:1905] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:22.041378 30576 ts_tablet_manager.cc:1918] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:22.041534 30576 log.cc:1196] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/4a06b8b6e7704ef3afdb5f1fd234f0c7
I20260923 19:40:22.042181 30574 tablet_replica.cc:330] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: stopping tablet replica
I20260923 19:40:22.042232 30576 ts_tablet_manager.cc:1939] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 43fddc4969dc41c2bdc0359b60ab025d: Deleting consensus metadata
I20260923 19:40:22.042717 30574 raft_consensus.cc:2229] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:22.043238 30574 raft_consensus.cc:2258] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:22.044391 30062 catalog_manager.cc:4841] TS 43fddc4969dc41c2bdc0359b60ab025d (127.12.159.195:44033): tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 (table test-table [id=05ac345db79342a2be37ccdd88b108b7]) successfully deleted
I20260923 19:40:22.051213 30575 ts_tablet_manager.cc:1918] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:22.051479 30575 log.cc:1196] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/4a06b8b6e7704ef3afdb5f1fd234f0c7
I20260923 19:40:22.052134 30575 ts_tablet_manager.cc:1939] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 41d969b52d8342d69d7428fc00bb9f66: Deleting consensus metadata
I20260923 19:40:22.054157 30059 catalog_manager.cc:4841] TS 41d969b52d8342d69d7428fc00bb9f66 (127.12.159.193:40765): tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 (table test-table [id=05ac345db79342a2be37ccdd88b108b7]) successfully deleted
I20260923 19:40:22.054586 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:22.016724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.12.159.193:40765)
0923 19:40:22.016918 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:22.016925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:22.027663 (+ 10738us) server_negotiation.cc:407] Connection header received
0923 19:40:22.027964 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:22.027970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:22.028060 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:22.028146 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:22.030090 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:22.031407 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:22.033423 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:22.034189 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:22.034302 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:22.046348 (+ 12046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:22.046362 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:22.046379 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:22.046431 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:22.050838 (+ 4407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:22.051839 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:22.051849 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:22.051853 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:22.052057 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:22.052546 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:22.052551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:22.052555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:22.052973 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:22.053352 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:22.053963 (+ 611us) server_negotiation.cc:299] Negotiation successful
0923 19:40:22.054229 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:40:22.056011 30259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:22.057552 30574 ts_tablet_manager.cc:1905] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:22.063530 30574 ts_tablet_manager.cc:1918] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:22.063731 30574 log.cc:1196] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/4a06b8b6e7704ef3afdb5f1fd234f0c7
I20260923 19:40:22.064217 30574 ts_tablet_manager.cc:1939] T 4a06b8b6e7704ef3afdb5f1fd234f0c7 P 434e83442f504edd81f867d3fecbc151: Deleting consensus metadata
I20260923 19:40:22.065909 30062 catalog_manager.cc:4841] TS 434e83442f504edd81f867d3fecbc151 (127.12.159.194:45377): tablet 4a06b8b6e7704ef3afdb5f1fd234f0c7 (table test-table [id=05ac345db79342a2be37ccdd88b108b7]) successfully deleted
I20260923 19:40:22.160737 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30136
I20260923 19:40:22.179663 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30270
Sep 23 19:40:22 dist-test-slave-lzv7 krb5kdc[30030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:40:22.205739 30549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:22.180576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52946 (local address 127.12.159.194:45377)
0923 19:40:22.180764 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:22.180772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:22.180797 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:40:22.181022 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:22.181027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:22.181105 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:22.181217 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:22.182630 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:22.183372 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:22.184665 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:22.185069 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:22.185203 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:22.192163 (+ 6960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:22.192187 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:22.192213 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:22.192254 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:22.201265 (+ 9011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:22.202427 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:22.202438 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:22.202441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:22.202639 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:22.203118 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:22.203124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:22.203128 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:22.203592 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:22.203893 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:22.205116 (+ 1223us) server_negotiation.cc:299] Negotiation successful
0923 19:40:22.205377 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:40:22.206645 30393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:22.308624 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30270
I20260923 19:40:22.325768 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30404
Sep 23 19:40:22 dist-test-slave-lzv7 krb5kdc[30030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:40:22.349855 30546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:22.326752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47924 (local address 127.12.159.195:44033)
0923 19:40:22.326933 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:22.326938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:22.326958 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:40:22.327206 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:22.327210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:22.327289 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:22.327381 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:22.328697 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:22.329478 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:22.331274 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:22.331695 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:22.331841 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:22.343935 (+ 12094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:22.343954 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:22.343971 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:22.344015 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:22.346933 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:22.347816 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:22.347823 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:22.347825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:22.347961 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:22.348348 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:22.348351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:22.348353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:22.348710 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:22.348919 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:22.349241 (+ 322us) server_negotiation.cc:299] Negotiation successful
0923 19:40:22.349425 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:40:22.350518 30527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:22.442164 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30404
I20260923 19:40:22.459007 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30043
I20260923 19:40:22.460213 30105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:22.577028 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30043
2026-09-23T19:40:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4383 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-23T19:40:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:22Z Disabled control of system clock
I20260923 19:40:22.656670 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34919
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:38915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:34919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:40:23.000084 30585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:23.000389 30585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:23.000530 30585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:23.008558 30585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:23.008697 30585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:23.008800 30585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:23.008894 30585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:23.008980 30585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:23.018684 30585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:34919
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:34919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:23.020183 30585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:23.022178 30585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:23.035617 30590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:23.035854 30591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:23.035642 30593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:23.036978 30585 server_base.cc:1034] running on GCE node
I20260923 19:40:23.037951 30585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:23.039454 30585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:23.040709 30585 hybrid_clock.cc:648] HybridClock initialized: now 1790192423040632 us; error 62 us; skew 500 ppm
I20260923 19:40:23.041123 30585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:23.043608 30585 webserver.cc:460] Webserver started at http://127.12.159.254:33865/ using document root <none> and password file <none>
I20260923 19:40:23.044340 30585 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:23.044433 30585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:23.044770 30585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:23.047865 30585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "77709138f19e4c84bbb8173257552a33"
format_stamp: "Formatted at 2026-09-23 19:40:23 on dist-test-slave-lzv7"
server_key: "e49275b9ed3990f40567b7e4d6459901"
server_key_iv: "635f9fab7f6c683c3641d504cf9f2a17"
server_key_version: "encryptionkey@0"
I20260923 19:40:23.048718 30585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "77709138f19e4c84bbb8173257552a33"
format_stamp: "Formatted at 2026-09-23 19:40:23 on dist-test-slave-lzv7"
server_key: "e49275b9ed3990f40567b7e4d6459901"
server_key_iv: "635f9fab7f6c683c3641d504cf9f2a17"
server_key_version: "encryptionkey@0"
I20260923 19:40:23.054526 30585 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:40:23.058369 30599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:23.059834 30585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:40:23.060045 30585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "77709138f19e4c84bbb8173257552a33"
format_stamp: "Formatted at 2026-09-23 19:40:23 on dist-test-slave-lzv7"
server_key: "e49275b9ed3990f40567b7e4d6459901"
server_key_iv: "635f9fab7f6c683c3641d504cf9f2a17"
server_key_version: "encryptionkey@0"
I20260923 19:40:23.060287 30585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:23.082690 30585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:23.083679 30585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:23.084033 30585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:23.104882 30585 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:34919
I20260923 19:40:23.104899 30650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:34919 every 8 connection(s)
I20260923 19:40:23.106355 30585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:23.110165 30651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:23.112090 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30585
I20260923 19:40:23.112305 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:23.112851 12927 external_mini_cluster.cc:1428] Setting key ceb85f93c713bade2f4d9dcefc6fb32b
I20260923 19:40:23.123777 30651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33: Bootstrap starting.
I20260923 19:40:23.127799 30651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:23.128301 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:23.114832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37472 (local address 127.12.159.254:34919)
0923 19:40:23.115964 (+ 1132us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:23.115976 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:23.116021 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:40:23.118141 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:23.118166 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:23.118648 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:23.118991 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:23.119704 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:23.121472 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:23.123411 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:23.124190 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:23.124341 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:23.125752 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:23.125760 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:23.125777 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:23.126409 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:23.126499 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:23.126520 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:23.126620 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:23.126857 (+ 237us) server_negotiation.cc:299] Negotiation successful
0923 19:40:23.127236 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":468,"threads_started":1}
I20260923 19:40:23.128993 30651 log.cc:824] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:23.132434 30651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33: No bootstrap required, opened a new log
I20260923 19:40:23.140144 30651 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709138f19e4c84bbb8173257552a33" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34919 } }
I20260923 19:40:23.140503 30651 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:23.140591 30651 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77709138f19e4c84bbb8173257552a33, State: Initialized, Role: FOLLOWER
I20260923 19:40:23.141142 30651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709138f19e4c84bbb8173257552a33" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34919 } }
I20260923 19:40:23.141394 30651 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:23.141501 30651 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:23.141633 30651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:23.144196 30651 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709138f19e4c84bbb8173257552a33" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34919 } }
I20260923 19:40:23.144671 30651 leader_election.cc:302] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77709138f19e4c84bbb8173257552a33; no voters:
I20260923 19:40:23.145545 30651 leader_election.cc:288] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:23.145857 30656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:23.146682 30656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [term 1 LEADER]: Becoming Leader. State: Replica: 77709138f19e4c84bbb8173257552a33, State: Running, Role: LEADER
I20260923 19:40:23.147185 30656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709138f19e4c84bbb8173257552a33" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34919 } }
I20260923 19:40:23.147835 30651 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:23.150259 30658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77709138f19e4c84bbb8173257552a33. Latest consensus state: current_term: 1 leader_uuid: "77709138f19e4c84bbb8173257552a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709138f19e4c84bbb8173257552a33" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34919 } } }
I20260923 19:40:23.150781 30658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:23.150386 30657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77709138f19e4c84bbb8173257552a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709138f19e4c84bbb8173257552a33" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 34919 } } }
I20260923 19:40:23.151396 30657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:23.155021 30664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:23.160378 30664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:23.169543 30664 catalog_manager.cc:1347] Generated new cluster ID: 941c55455b704ee8a23f63bbd22f1eea
I20260923 19:40:23.169718 30664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:23.179970 30664 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:23.181277 30664 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:23.196789 30664 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33: Generated new TSK 0
I20260923 19:40:23.197743 30664 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:23.211612 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34919
--builtin_ntp_servers=127.12.159.212:38915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:40:23.577996 30675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:23.578318 30675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:23.578408 30675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:23.586086 30675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:23.586216 30675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:23.586325 30675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:40:23.596014 30675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:23.597409 30675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:23.599225 30675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:23.613361 30680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:23.613449 30681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:23.613466 30683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:23.614669 30675 server_base.cc:1034] running on GCE node
I20260923 19:40:23.615329 30675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:23.616391 30675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:23.617609 30675 hybrid_clock.cc:648] HybridClock initialized: now 1790192423617567 us; error 34 us; skew 500 ppm
I20260923 19:40:23.618028 30675 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:23.620465 30675 webserver.cc:460] Webserver started at http://127.12.159.193:41619/ using document root <none> and password file <none>
I20260923 19:40:23.621224 30675 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:23.621340 30675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:23.621692 30675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:23.624855 30675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "353bd9df45754908ac62eeb4234162bd"
format_stamp: "Formatted at 2026-09-23 19:40:23 on dist-test-slave-lzv7"
server_key: "54335ec70d46ef171823415cf3ca26cb"
server_key_iv: "18b03bf20b9c84d39ec16d597327e59e"
server_key_version: "encryptionkey@0"
I20260923 19:40:23.625730 30675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "353bd9df45754908ac62eeb4234162bd"
format_stamp: "Formatted at 2026-09-23 19:40:23 on dist-test-slave-lzv7"
server_key: "54335ec70d46ef171823415cf3ca26cb"
server_key_iv: "18b03bf20b9c84d39ec16d597327e59e"
server_key_version: "encryptionkey@0"
I20260923 19:40:23.632275 30675 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260923 19:40:23.636034 30689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:23.637486 30675 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:40:23.637682 30675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "353bd9df45754908ac62eeb4234162bd"
format_stamp: "Formatted at 2026-09-23 19:40:23 on dist-test-slave-lzv7"
server_key: "54335ec70d46ef171823415cf3ca26cb"
server_key_iv: "18b03bf20b9c84d39ec16d597327e59e"
server_key_version: "encryptionkey@0"
I20260923 19:40:23.638021 30675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:23.653728 30675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:23.654685 30675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:23.655004 30675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:23.656005 30675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:23.657517 30675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:23.657645 30675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:23.657779 30675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:23.657899 30675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260923 19:40:23.697412 30675 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:41543
I20260923 19:40:23.697471 30801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:41543 every 8 connection(s)
I20260923 19:40:23.699071 30675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:40:23.702060 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30675
I20260923 19:40:23.702270 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:40:23.702888 12927 external_mini_cluster.cc:1428] Setting key 7e1974ed276cc53d32096b76d9e00ce1
I20260923 19:40:23.705878 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34919
--builtin_ntp_servers=127.12.159.212:38915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:40:23.714494 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:23.702318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:54793 (local address 127.12.159.254:34919)
0923 19:40:23.702857 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:23.702866 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:23.704562 (+ 1696us) server_negotiation.cc:407] Connection header received
0923 19:40:23.706815 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:23.706825 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:23.706926 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:23.707065 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:23.708169 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:23.709404 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:23.711069 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:23.711882 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:23.712040 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:23.713561 (+ 1521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:23.713571 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:23.713580 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:23.713609 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:23.713670 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:23.713690 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:23.713796 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:23.714121 (+ 325us) server_negotiation.cc:299] Negotiation successful
0923 19:40:23.714211 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":263,"threads_started":1}
I20260923 19:40:23.715930 30805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:23.703166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34919 (local address 127.12.159.193:54793)
0923 19:40:23.704361 (+ 1195us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:23.704412 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:23.706514 (+ 2102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:23.707302 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:23.707311 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:23.707400 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:23.707984 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:23.708001 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:23.709549 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:23.709553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:23.710911 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:23.710924 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:23.712173 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:23.712178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:23.712400 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:23.713174 (+ 774us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:23.713176 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:23.713217 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:23.713295 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:23.713798 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:23.713861 (+ 63us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:23.713872 (+ 11us) client_negotiation.cc:769] Sending connection context
0923 19:40:23.714081 (+ 209us) client_negotiation.cc:240] Negotiation successful
0923 19:40:23.714547 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":393,"threads_started":1}
I20260923 19:40:23.717613 30802 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34919
I20260923 19:40:23.718000 30802 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:23.718816 30802 heartbeater.cc:511] Master 127.12.159.254:34919 requested a full tablet report, sending...
I20260923 19:40:23.721089 30616 ts_manager.cc:194] Registered new tserver with Master: 353bd9df45754908ac62eeb4234162bd (127.12.159.193:41543)
I20260923 19:40:23.722780 30616 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.193:54793
W20260923 19:40:24.047786 30806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:24.048180 30806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:24.048339 30806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:24.056043 30806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:24.056190 30806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:24.056368 30806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:40:24.066166 30806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:24.067559 30806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:24.069428 30806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:24.083519 30811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:24.083477 30812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:24.083436 30814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:24.084568 30806 server_base.cc:1034] running on GCE node
I20260923 19:40:24.085175 30806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:24.086225 30806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:24.087422 30806 hybrid_clock.cc:648] HybridClock initialized: now 1790192424087383 us; error 40 us; skew 500 ppm
I20260923 19:40:24.087780 30806 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:24.090103 30806 webserver.cc:460] Webserver started at http://127.12.159.194:34793/ using document root <none> and password file <none>
I20260923 19:40:24.090813 30806 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:24.090929 30806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:24.091266 30806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:24.094264 30806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "f38775c5d8b0455c900aaefa6df9fe83"
format_stamp: "Formatted at 2026-09-23 19:40:24 on dist-test-slave-lzv7"
server_key: "70b95c5d6682f203d81eca9c3c2f8d85"
server_key_iv: "5fa1e0da19007ac1f7be005116b91ffe"
server_key_version: "encryptionkey@0"
I20260923 19:40:24.095103 30806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "f38775c5d8b0455c900aaefa6df9fe83"
format_stamp: "Formatted at 2026-09-23 19:40:24 on dist-test-slave-lzv7"
server_key: "70b95c5d6682f203d81eca9c3c2f8d85"
server_key_iv: "5fa1e0da19007ac1f7be005116b91ffe"
server_key_version: "encryptionkey@0"
I20260923 19:40:24.100428 30806 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260923 19:40:24.104157 30820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:24.105844 30806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:40:24.106012 30806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "f38775c5d8b0455c900aaefa6df9fe83"
format_stamp: "Formatted at 2026-09-23 19:40:24 on dist-test-slave-lzv7"
server_key: "70b95c5d6682f203d81eca9c3c2f8d85"
server_key_iv: "5fa1e0da19007ac1f7be005116b91ffe"
server_key_version: "encryptionkey@0"
I20260923 19:40:24.106251 30806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:24.135972 30806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:24.136850 30806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:24.137178 30806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:24.138201 30806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:24.139689 30806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:24.139801 30806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:24.139930 30806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:24.140026 30806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:24.174909 30806 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:44823
I20260923 19:40:24.174989 30932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:44823 every 8 connection(s)
I20260923 19:40:24.176254 30806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:40:24.184468 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30806
I20260923 19:40:24.184691 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:40:24.185282 12927 external_mini_cluster.cc:1428] Setting key 5a9376774ca8d829f234e0b61605a7af
I20260923 19:40:24.188881 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34919
--builtin_ntp_servers=127.12.159.212:38915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:40:24.190127 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.179056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:54141 (local address 127.12.159.254:34919)
0923 19:40:24.179266 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.179271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.180635 (+ 1364us) server_negotiation.cc:407] Connection header received
0923 19:40:24.182538 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.182543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.182615 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.182707 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:24.183872 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.184661 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.186727 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.187405 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.187554 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.189304 (+ 1750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:24.189309 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:24.189312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:24.189332 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:24.189364 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:24.189376 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:24.189450 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.189731 (+ 281us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.189869 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:40:24.191726 30935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.179528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34919 (local address 127.12.159.194:54141)
0923 19:40:24.180462 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:24.180509 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:24.182265 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:24.182976 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:24.182986 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:24.183085 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:24.183699 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.183717 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.184866 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.184873 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.186582 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.186597 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.187679 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.187689 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.188001 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.188807 (+ 806us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:24.188812 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:24.188872 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:24.188998 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:24.189481 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:24.189495 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:24.189506 (+ 11us) client_negotiation.cc:769] Sending connection context
0923 19:40:24.189712 (+ 206us) client_negotiation.cc:240] Negotiation successful
0923 19:40:24.190236 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":282,"threads_started":1}
I20260923 19:40:24.193328 30933 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34919
I20260923 19:40:24.193677 30933 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:24.194509 30933 heartbeater.cc:511] Master 127.12.159.254:34919 requested a full tablet report, sending...
I20260923 19:40:24.196019 30616 ts_manager.cc:194] Registered new tserver with Master: f38775c5d8b0455c900aaefa6df9fe83 (127.12.159.194:44823)
I20260923 19:40:24.197247 30616 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.194:54141
W20260923 19:40:24.534509 30936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:24.534808 30936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:24.534904 30936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:24.543378 30936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:24.543502 30936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:24.543610 30936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:40:24.553471 30936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:34919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:24.554900 30936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:24.556630 30936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:24.570422 30942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:24.570601 30941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:24.570580 30944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:24.571579 30936 server_base.cc:1034] running on GCE node
I20260923 19:40:24.572202 30936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:24.573184 30936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:24.574393 30936 hybrid_clock.cc:648] HybridClock initialized: now 1790192424574337 us; error 38 us; skew 500 ppm
I20260923 19:40:24.574743 30936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:24.576990 30936 webserver.cc:460] Webserver started at http://127.12.159.195:38003/ using document root <none> and password file <none>
I20260923 19:40:24.577720 30936 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:24.577864 30936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:24.578245 30936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:24.581175 30936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "1ee9d91226064a83bbd3fefc90d34ff1"
format_stamp: "Formatted at 2026-09-23 19:40:24 on dist-test-slave-lzv7"
server_key: "7e620580f80225b598b8326684f832ab"
server_key_iv: "852647e2313797a9e06b28c0d9897b3c"
server_key_version: "encryptionkey@0"
I20260923 19:40:24.582085 30936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "1ee9d91226064a83bbd3fefc90d34ff1"
format_stamp: "Formatted at 2026-09-23 19:40:24 on dist-test-slave-lzv7"
server_key: "7e620580f80225b598b8326684f832ab"
server_key_iv: "852647e2313797a9e06b28c0d9897b3c"
server_key_version: "encryptionkey@0"
I20260923 19:40:24.587939 30936 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:40:24.592098 30950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:24.593535 30936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:40:24.593743 30936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "1ee9d91226064a83bbd3fefc90d34ff1"
format_stamp: "Formatted at 2026-09-23 19:40:24 on dist-test-slave-lzv7"
server_key: "7e620580f80225b598b8326684f832ab"
server_key_iv: "852647e2313797a9e06b28c0d9897b3c"
server_key_version: "encryptionkey@0"
I20260923 19:40:24.594065 30936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:24.609411 30936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:24.610347 30936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:24.610653 30936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:24.611714 30936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:24.613186 30936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:24.613306 30936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:24.613440 30936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:24.613526 30936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:24.650445 30936 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:41307
I20260923 19:40:24.650467 31062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:41307 every 8 connection(s)
I20260923 19:40:24.651923 30936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:40:24.656388 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 30936
I20260923 19:40:24.656585 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:40:24.657158 12927 external_mini_cluster.cc:1428] Setting key 54482faad2280f9fb292184caed21881
I20260923 19:40:24.665702 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.654671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:59447 (local address 127.12.159.254:34919)
0923 19:40:24.654894 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.654900 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.656497 (+ 1597us) server_negotiation.cc:407] Connection header received
0923 19:40:24.658827 (+ 2330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.658833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.658945 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.659030 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:24.660309 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.661045 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.662737 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.663121 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.663214 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.664702 (+ 1488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:24.664709 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:24.664716 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:24.664741 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:24.664782 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:24.664800 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:24.664914 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.665289 (+ 375us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.665417 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 19:40:24.666745 31065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.655254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:34919 (local address 127.12.159.195:59447)
0923 19:40:24.656287 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:24.656342 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:24.658520 (+ 2178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:24.659315 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:24.659329 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:24.659420 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:24.660149 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.660178 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.661180 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.661184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.662614 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.662626 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.663312 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.663316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.663528 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.664262 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:24.664268 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:24.664342 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:24.664454 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:24.664919 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:24.664930 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:24.664941 (+ 11us) client_negotiation.cc:769] Sending connection context
0923 19:40:24.665257 (+ 316us) client_negotiation.cc:240] Negotiation successful
0923 19:40:24.665641 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":273,"threads_started":1}
I20260923 19:40:24.668179 31063 heartbeater.cc:347] Connected to a master server at 127.12.159.254:34919
I20260923 19:40:24.668471 31063 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:24.669240 31063 heartbeater.cc:511] Master 127.12.159.254:34919 requested a full tablet report, sending...
I20260923 19:40:24.670683 30616 ts_manager.cc:194] Registered new tserver with Master: 1ee9d91226064a83bbd3fefc90d34ff1 (127.12.159.195:41307)
I20260923 19:40:24.671521 30616 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.195:59447
I20260923 19:40:24.672442 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:40:24.683044 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.677121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37476 (local address 127.12.159.254:34919)
0923 19:40:24.677281 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.677285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.677850 (+ 565us) server_negotiation.cc:407] Connection header received
0923 19:40:24.678087 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.678091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.678162 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.678248 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:24.678734 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.679434 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.680864 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.681277 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.681375 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.682423 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:24.682428 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:24.682431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:24.682450 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:24.682483 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:24.682494 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:24.682583 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.682738 (+ 155us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.682816 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:40:24.686921 30615 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37476:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:40:24.695057 30615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:40:24.726500 30802 heartbeater.cc:503] Master 127.12.159.254:34919 was elected leader, sending a full tablet report...
I20260923 19:40:24.734167 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.708534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58730)
0923 19:40:24.709557 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:24.709609 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:24.709885 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:24.724595 (+ 14710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:24.724600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:24.724628 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:24.725083 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.725095 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.727431 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.727437 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.730632 (+ 3195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.730650 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.732956 (+ 2306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.732966 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.733202 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.733280 (+ 78us) client_negotiation.cc:769] Sending connection context
0923 19:40:24.733406 (+ 126us) client_negotiation.cc:240] Negotiation successful
0923 19:40:24.733633 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":104,"thread_start_us":389,"threads_started":1}
I20260923 19:40:24.734876 31077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.709772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:44823 (local address 127.0.0.1:58818)
0923 19:40:24.716761 (+ 6989us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:24.716791 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:24.716966 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:24.723888 (+ 6922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:24.723897 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:24.723943 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:24.724392 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.724411 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.727109 (+ 2698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.727116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.730655 (+ 3539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.730702 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.733884 (+ 3182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.733892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.734123 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.734175 (+ 52us) client_negotiation.cc:769] Sending connection context
0923 19:40:24.734368 (+ 193us) client_negotiation.cc:240] Negotiation successful
0923 19:40:24.734527 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6750,"mutex_wait_us":200,"thread_start_us":6693,"threads_started":1}
I20260923 19:40:24.735536 31076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.708913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58730 (local address 127.12.159.193:41543)
0923 19:40:24.723792 (+ 14879us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.723803 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.723837 (+ 34us) server_negotiation.cc:407] Connection header received
0923 19:40:24.723946 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.723954 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.724230 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.725298 (+ 1068us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:24.725556 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.727260 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.730941 (+ 3681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.732695 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.734537 (+ 1842us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.734796 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.734885 (+ 89us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.735121 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14694,"thread_start_us":14570,"threads_started":1}
I20260923 19:40:24.735886 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.709772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:41307 (local address 127.0.0.1:56410)
0923 19:40:24.726524 (+ 16752us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:24.726546 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:24.726659 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:24.727965 (+ 1306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:24.727969 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:24.727999 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:24.728534 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.728547 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.730075 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.730080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.732997 (+ 2917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.733016 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.735103 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.735111 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.735305 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.735342 (+ 37us) client_negotiation.cc:769] Sending connection context
0923 19:40:24.735419 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 19:40:24.735560 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16616,"mutex_wait_us":404,"thread_start_us":16545,"threads_started":1}
I20260923 19:40:24.736034 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.710258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56410 (local address 127.12.159.195:41307)
0923 19:40:24.727348 (+ 17090us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.727357 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.727392 (+ 35us) server_negotiation.cc:407] Connection header received
0923 19:40:24.727500 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.727506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.727738 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.728574 (+ 836us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:24.728842 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.729792 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.733251 (+ 3459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.734816 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.735040 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.735413 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.735481 (+ 68us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.735660 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16906,"thread_start_us":18014,"threads_started":1}
I20260923 19:40:24.737669 31080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.710425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58818 (local address 127.12.159.194:44823)
0923 19:40:24.722208 (+ 11783us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.722224 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.722271 (+ 47us) server_negotiation.cc:407] Connection header received
0923 19:40:24.722417 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.722430 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.722821 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.724653 (+ 1832us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:24.724943 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.726945 (+ 2002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.731027 (+ 4082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.733613 (+ 2586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.735406 (+ 1793us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.735873 (+ 467us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.736225 (+ 352us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.736410 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11506,"thread_start_us":12616,"threads_started":1}
I20260923 19:40:24.739568 30998 tablet_service.cc:1467] Processing CreateTablet for tablet e6cda7d34b59430a93d78335dfc4ae32 (DEFAULT_TABLE table=test-table [id=7bf09ebd61a04386853a1ddc6f960960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:24.739739 30737 tablet_service.cc:1467] Processing CreateTablet for tablet e6cda7d34b59430a93d78335dfc4ae32 (DEFAULT_TABLE table=test-table [id=7bf09ebd61a04386853a1ddc6f960960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:24.741371 30737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6cda7d34b59430a93d78335dfc4ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:24.741770 30998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6cda7d34b59430a93d78335dfc4ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:24.741775 30868 tablet_service.cc:1467] Processing CreateTablet for tablet e6cda7d34b59430a93d78335dfc4ae32 (DEFAULT_TABLE table=test-table [id=7bf09ebd61a04386853a1ddc6f960960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:24.743387 30868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6cda7d34b59430a93d78335dfc4ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:24.754395 31081 tablet_bootstrap.cc:492] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Bootstrap starting.
I20260923 19:40:24.757819 31081 tablet_bootstrap.cc:654] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:24.758569 31082 tablet_bootstrap.cc:492] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Bootstrap starting.
I20260923 19:40:24.759410 31081 log.cc:824] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:24.760603 31083 tablet_bootstrap.cc:492] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Bootstrap starting.
I20260923 19:40:24.762494 31082 tablet_bootstrap.cc:654] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:24.763797 31082 log.cc:824] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:24.765152 31081 tablet_bootstrap.cc:492] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: No bootstrap required, opened a new log
I20260923 19:40:24.765496 31081 ts_tablet_manager.cc:1397] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.001s
I20260923 19:40:24.765602 31083 tablet_bootstrap.cc:654] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:24.766757 31083 log.cc:824] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:24.767405 31082 tablet_bootstrap.cc:492] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: No bootstrap required, opened a new log
I20260923 19:40:24.767688 31082 ts_tablet_manager.cc:1397] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260923 19:40:24.769578 31083 tablet_bootstrap.cc:492] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: No bootstrap required, opened a new log
I20260923 19:40:24.769936 31083 ts_tablet_manager.cc:1397] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260923 19:40:24.776533 31081 raft_consensus.cc:348] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.777019 31081 raft_consensus.cc:374] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:24.777122 31081 raft_consensus.cc:729] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ee9d91226064a83bbd3fefc90d34ff1, State: Initialized, Role: FOLLOWER
I20260923 19:40:24.777791 31081 consensus_queue.cc:260] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.778383 31082 raft_consensus.cc:348] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.778509 31083 raft_consensus.cc:348] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.778839 31082 raft_consensus.cc:374] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:24.778927 31082 raft_consensus.cc:729] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353bd9df45754908ac62eeb4234162bd, State: Initialized, Role: FOLLOWER
I20260923 19:40:24.778978 31083 raft_consensus.cc:374] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:24.779103 31083 raft_consensus.cc:729] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38775c5d8b0455c900aaefa6df9fe83, State: Initialized, Role: FOLLOWER
I20260923 19:40:24.779381 31063 heartbeater.cc:503] Master 127.12.159.254:34919 was elected leader, sending a full tablet report...
I20260923 19:40:24.779539 31082 consensus_queue.cc:260] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.779868 31081 ts_tablet_manager.cc:1428] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Time spent starting tablet: real 0.014s user 0.011s sys 0.005s
I20260923 19:40:24.779736 31083 consensus_queue.cc:260] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.780979 30933 heartbeater.cc:503] Master 127.12.159.254:34919 was elected leader, sending a full tablet report...
I20260923 19:40:24.781734 31083 ts_tablet_manager.cc:1428] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260923 19:40:24.785039 31082 ts_tablet_manager.cc:1428] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Time spent starting tablet: real 0.017s user 0.010s sys 0.007s
I20260923 19:40:24.814882 31088 raft_consensus.cc:482] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:40:24.815240 31088 raft_consensus.cc:504] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.817332 31088 leader_election.cc:288] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ee9d91226064a83bbd3fefc90d34ff1 (127.12.159.195:41307), f38775c5d8b0455c900aaefa6df9fe83 (127.12.159.194:44823)
I20260923 19:40:24.824460 31080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.818009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:33613 (local address 127.12.159.194:44823)
0923 19:40:24.818256 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.818261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.818831 (+ 570us) server_negotiation.cc:407] Connection header received
0923 19:40:24.819037 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.819041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.819112 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.819213 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:24.819942 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.820617 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.822752 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.823538 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.823716 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.823790 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.824057 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.824184 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:40:24.824481 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.817785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:50835 (local address 127.12.159.195:41307)
0923 19:40:24.818023 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.818032 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.818775 (+ 743us) server_negotiation.cc:407] Connection header received
0923 19:40:24.819009 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.819013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.819073 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.819194 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:24.819854 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.820572 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.822780 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.823574 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.823761 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.823832 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.824107 (+ 275us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.824235 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260923 19:40:24.824764 31091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.817878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:44823 (local address 127.12.159.193:33613)
0923 19:40:24.818720 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:24.818734 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:24.818893 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:24.819227 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:24.819232 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:24.819254 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:24.819772 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.819782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.820772 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.820783 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.822553 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.822568 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.823731 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.823737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.823893 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.823918 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 19:40:24.824025 (+ 107us) client_negotiation.cc:240] Negotiation successful
0923 19:40:24.824163 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":110,"thread_start_us":555,"threads_started":1}
I20260923 19:40:24.824922 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.817565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:41307 (local address 127.12.159.193:50835)
0923 19:40:24.818636 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:24.818656 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:24.818853 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:24.819211 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:24.819215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:24.819239 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:24.819695 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.819704 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.820716 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.820724 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.822577 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:24.822589 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.823777 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.823783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:24.823943 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.823965 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:40:24.824070 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:40:24.824197 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":132,"thread_start_us":648,"threads_started":1}
I20260923 19:40:24.825933 30888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cda7d34b59430a93d78335dfc4ae32" candidate_uuid: "353bd9df45754908ac62eeb4234162bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38775c5d8b0455c900aaefa6df9fe83" is_pre_election: true
I20260923 19:40:24.826004 31018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cda7d34b59430a93d78335dfc4ae32" candidate_uuid: "353bd9df45754908ac62eeb4234162bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" is_pre_election: true
I20260923 19:40:24.826484 30888 raft_consensus.cc:2454] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353bd9df45754908ac62eeb4234162bd in term 0.
I20260923 19:40:24.826496 31018 raft_consensus.cc:2454] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353bd9df45754908ac62eeb4234162bd in term 0.
I20260923 19:40:24.827153 30690 leader_election.cc:302] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ee9d91226064a83bbd3fefc90d34ff1, 353bd9df45754908ac62eeb4234162bd; no voters:
I20260923 19:40:24.827584 31088 raft_consensus.cc:2781] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:40:24.827734 31088 raft_consensus.cc:482] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:40:24.827838 31088 raft_consensus.cc:3037] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:24.830114 31088 raft_consensus.cc:504] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.830814 31088 leader_election.cc:288] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [CANDIDATE]: Term 1 election: Requested vote from peers 1ee9d91226064a83bbd3fefc90d34ff1 (127.12.159.195:41307), f38775c5d8b0455c900aaefa6df9fe83 (127.12.159.194:44823)
I20260923 19:40:24.831344 31018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cda7d34b59430a93d78335dfc4ae32" candidate_uuid: "353bd9df45754908ac62eeb4234162bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ee9d91226064a83bbd3fefc90d34ff1"
I20260923 19:40:24.831395 30888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6cda7d34b59430a93d78335dfc4ae32" candidate_uuid: "353bd9df45754908ac62eeb4234162bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38775c5d8b0455c900aaefa6df9fe83"
I20260923 19:40:24.831607 30888 raft_consensus.cc:3037] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:24.831591 31018 raft_consensus.cc:3037] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:24.835022 30888 raft_consensus.cc:2454] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353bd9df45754908ac62eeb4234162bd in term 1.
I20260923 19:40:24.835027 31018 raft_consensus.cc:2454] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353bd9df45754908ac62eeb4234162bd in term 1.
I20260923 19:40:24.835541 30692 leader_election.cc:302] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353bd9df45754908ac62eeb4234162bd, f38775c5d8b0455c900aaefa6df9fe83; no voters:
I20260923 19:40:24.835927 31088 raft_consensus.cc:2781] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:24.836421 31088 raft_consensus.cc:686] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 1 LEADER]: Becoming Leader. State: Replica: 353bd9df45754908ac62eeb4234162bd, State: Running, Role: LEADER
I20260923 19:40:24.836969 31088 consensus_queue.cc:237] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } }
I20260923 19:40:24.841630 30614 catalog_manager.cc:5495] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 353bd9df45754908ac62eeb4234162bd (127.12.159.193). New cstate: current_term: 1 leader_uuid: "353bd9df45754908ac62eeb4234162bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353bd9df45754908ac62eeb4234162bd" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 41543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 } health_report { overall_health: UNKNOWN } } }
I20260923 19:40:24.877611 31076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.871791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58740 (local address 127.12.159.193:41543)
0923 19:40:24.872001 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.872006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.872044 (+ 38us) server_negotiation.cc:407] Connection header received
0923 19:40:24.872250 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.872254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.872359 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.872490 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:40:24.872900 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.873586 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.875213 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.875675 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.875778 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.876358 (+ 580us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:40:24.876904 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:40:24.877028 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.877329 (+ 301us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.877400 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 19:40:24.886636 31018 raft_consensus.cc:1261] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 1 FOLLOWER]: Refusing update from remote peer 353bd9df45754908ac62eeb4234162bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:24.886636 30888 raft_consensus.cc:1261] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 1 FOLLOWER]: Refusing update from remote peer 353bd9df45754908ac62eeb4234162bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:24.887774 31092 consensus_queue.cc:1035] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ee9d91226064a83bbd3fefc90d34ff1" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:24.888182 31088 consensus_queue.cc:1035] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38775c5d8b0455c900aaefa6df9fe83" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 44823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:24.901134 31095 mvcc.cc:205] Tried to move back new op lower bound from 7332628172323442688 to 7332628172136845312. Current Snapshot: MvccSnapshot[applied={T|T < 7332628172323442688}]
I20260923 19:40:24.906733 31097 mvcc.cc:205] Tried to move back new op lower bound from 7332628172323442688 to 7332628172136845312. Current Snapshot: MvccSnapshot[applied={T|T < 7332628172323442688}]
I20260923 19:40:24.918799 30615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:24.919121 30615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:24.922935 30615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77709138f19e4c84bbb8173257552a33: Sending DeleteTablet for 3 replicas of tablet e6cda7d34b59430a93d78335dfc4ae32
I20260923 19:40:24.923995 30737 tablet_service.cc:1514] Processing DeleteTablet for tablet e6cda7d34b59430a93d78335dfc4ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:24 UTC) from {username='slave'} at 127.0.0.1:58730
I20260923 19:40:24.924153 30998 tablet_service.cc:1514] Processing DeleteTablet for tablet e6cda7d34b59430a93d78335dfc4ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:24 UTC) from {username='slave'} at 127.0.0.1:56410
I20260923 19:40:24.924752 30868 tablet_service.cc:1514] Processing DeleteTablet for tablet e6cda7d34b59430a93d78335dfc4ae32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:24 UTC) from {username='slave'} at 127.0.0.1:58818
I20260923 19:40:24.932001 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30675
I20260923 19:40:24.934931 31107 tablet_replica.cc:330] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: stopping tablet replica
I20260923 19:40:24.935410 31107 raft_consensus.cc:2229] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:24.936012 31107 raft_consensus.cc:2258] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:24.940316 31107 ts_tablet_manager.cc:1905] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:24.945660 31105 tablet_replica.cc:330] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: stopping tablet replica
I20260923 19:40:24.946210 31105 raft_consensus.cc:2229] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:40:24.946940 31105 raft_consensus.cc:2258] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:24.949419 31105 ts_tablet_manager.cc:1905] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:24.955168 31076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:24.934533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.12.159.193:41543)
0923 19:40:24.934731 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:24.934737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:24.944677 (+ 9940us) server_negotiation.cc:407] Connection header received
0923 19:40:24.945272 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:24.945282 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:24.945440 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:24.945536 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:24.946678 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.948122 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.950487 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:24.951150 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:24.951265 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:24.953203 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:24.953222 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:24.953247 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:24.954152 (+ 905us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:24.954214 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:24.954244 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:24.954347 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:24.954607 (+ 260us) server_negotiation.cc:299] Negotiation successful
0923 19:40:24.954726 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:40:24.956074 31107 ts_tablet_manager.cc:1918] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:24.956262 31107 log.cc:1196] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/e6cda7d34b59430a93d78335dfc4ae32
I20260923 19:40:24.956621 30797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:24.956843 31107 ts_tablet_manager.cc:1939] T e6cda7d34b59430a93d78335dfc4ae32 P f38775c5d8b0455c900aaefa6df9fe83: Deleting consensus metadata
I20260923 19:40:24.958241 31106 tablet_replica.cc:330] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: stopping tablet replica
I20260923 19:40:24.958740 31106 raft_consensus.cc:2229] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:24.959385 31106 raft_consensus.cc:2258] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:24.959407 30602 catalog_manager.cc:4841] TS f38775c5d8b0455c900aaefa6df9fe83 (127.12.159.194:44823): tablet e6cda7d34b59430a93d78335dfc4ae32 (table test-table [id=7bf09ebd61a04386853a1ddc6f960960]) successfully deleted
I20260923 19:40:24.961611 31106 ts_tablet_manager.cc:1905] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:24.966821 31106 ts_tablet_manager.cc:1918] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:24.966972 31106 log.cc:1196] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/e6cda7d34b59430a93d78335dfc4ae32
I20260923 19:40:24.967386 31106 ts_tablet_manager.cc:1939] T e6cda7d34b59430a93d78335dfc4ae32 P 1ee9d91226064a83bbd3fefc90d34ff1: Deleting consensus metadata
I20260923 19:40:24.968928 30600 catalog_manager.cc:4841] TS 1ee9d91226064a83bbd3fefc90d34ff1 (127.12.159.195:41307): tablet e6cda7d34b59430a93d78335dfc4ae32 (table test-table [id=7bf09ebd61a04386853a1ddc6f960960]) successfully deleted
I20260923 19:40:25.057644 31105 ts_tablet_manager.cc:1918] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:25.058012 31105 log.cc:1196] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/e6cda7d34b59430a93d78335dfc4ae32
I20260923 19:40:25.058612 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30675
I20260923 19:40:25.058732 31105 ts_tablet_manager.cc:1939] T e6cda7d34b59430a93d78335dfc4ae32 P 353bd9df45754908ac62eeb4234162bd: Deleting consensus metadata
I20260923 19:40:25.077302 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30806
W20260923 19:40:25.077301 30600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.159.193:41543 (error 108)
I20260923 19:40:25.079399 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.078888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58770)
0923 19:40:25.079091 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:25.079224 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 19:40:25.079653 30600 catalog_manager.cc:4584] TS 353bd9df45754908ac62eeb4234162bd (127.12.159.193:41543): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e6cda7d34b59430a93d78335dfc4ae32: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
I20260923 19:40:25.084654 31080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.078267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.12.159.194:44823)
0923 19:40:25.078439 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:25.078443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:25.078596 (+ 153us) server_negotiation.cc:407] Connection header received
0923 19:40:25.078872 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:25.078877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:25.078999 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:25.079112 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:25.079660 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:25.080495 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:25.082032 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:25.082441 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:25.082539 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:25.083433 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:25.083442 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:25.083455 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:25.084039 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:25.084083 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:25.084103 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:25.084193 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:25.084317 (+ 124us) server_negotiation.cc:299] Negotiation successful
0923 19:40:25.084400 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 19:40:25.085291 30928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:25.133394 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.132853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58782)
0923 19:40:25.133120 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:25.133226 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260923 19:40:25.134503 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.134158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58792)
0923 19:40:25.134312 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:25.134390 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 19:40:25.176646 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30806
I20260923 19:40:25.193933 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30936
I20260923 19:40:25.195274 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.194655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58798)
0923 19:40:25.194914 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:25.195018 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260923 19:40:25.196379 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.195979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58800)
0923 19:40:25.196152 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:25.196240 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260923 19:40:25.201325 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.194846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56422 (local address 127.12.159.195:41307)
0923 19:40:25.195048 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:25.195055 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:25.195163 (+ 108us) server_negotiation.cc:407] Connection header received
0923 19:40:25.195331 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:25.195337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:25.195456 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:25.195587 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:25.196060 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:25.196964 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:25.198337 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:25.198757 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:25.198905 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:25.199992 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:25.200002 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:25.200017 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:25.200585 (+ 568us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:25.200630 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:25.200649 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:25.200781 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:25.200923 (+ 142us) server_negotiation.cc:299] Negotiation successful
0923 19:40:25.201034 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:40:25.202080 31058 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:25.277259 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.276775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58806)
0923 19:40:25.277005 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:25.277098 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260923 19:40:25.278416 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:25.277989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:41543 (local address 127.0.0.1:58820)
0923 19:40:25.278217 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:25.278319 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260923 19:40:25.291733 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30936
I20260923 19:40:25.309324 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 30585
I20260923 19:40:25.310460 30646 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:25.420356 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 30585
2026-09-23T19:40:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2841 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:25 dist-test-slave-lzv7 krb5kdc[31116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:25 dist-test-slave-lzv7 krb5kdc[31116](info): set up 2 sockets
Sep 23 19:40:25 dist-test-slave-lzv7 krb5kdc[31116](info): commencing operation
krb5kdc: starting...
W20260923 19:40:26.542006 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:26 dist-test-slave-lzv7 krb5kdc[31116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:40:26.798094 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:39035
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:45945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:39035
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:27.134215 31129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:27.134574 31129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:27.134740 31129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:27.142215 31129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:27.142364 31129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:27.142462 31129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:27.142575 31129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:27.142670 31129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:27.152733 31129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:39035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:39035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:27.154127 31129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:27.155483 31129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:27.167845 31134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:27.167811 31137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:27.167869 31135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:27.168707 31129 server_base.cc:1034] running on GCE node
I20260923 19:40:27.169509 31129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:27.171166 31129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:27.172425 31129 hybrid_clock.cc:648] HybridClock initialized: now 1790192427172368 us; error 72 us; skew 500 ppm
I20260923 19:40:27.172802 31129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:27 dist-test-slave-lzv7 krb5kdc[31116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192427, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:27.176079 31129 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:40:27.177716 31129 webserver.cc:460] Webserver started at http://127.12.159.254:43309/ using document root <none> and password file <none>
I20260923 19:40:27.178447 31129 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:27.178599 31129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:27.178915 31129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:27.181991 31129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "2f77b82c2476473681e2f92723d01204"
format_stamp: "Formatted at 2026-09-23 19:40:27 on dist-test-slave-lzv7"
server_key: "6bc335bce0dd2d66b32156d5b4303ff3"
server_key_iv: "9c646bebf7b52714b488a17d2cfd2796"
server_key_version: "encryptionkey@0"
I20260923 19:40:27.182803 31129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "2f77b82c2476473681e2f92723d01204"
format_stamp: "Formatted at 2026-09-23 19:40:27 on dist-test-slave-lzv7"
server_key: "6bc335bce0dd2d66b32156d5b4303ff3"
server_key_iv: "9c646bebf7b52714b488a17d2cfd2796"
server_key_version: "encryptionkey@0"
I20260923 19:40:27.188627 31129 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:40:27.192463 31144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:27.193957 31129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:40:27.194168 31129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "2f77b82c2476473681e2f92723d01204"
format_stamp: "Formatted at 2026-09-23 19:40:27 on dist-test-slave-lzv7"
server_key: "6bc335bce0dd2d66b32156d5b4303ff3"
server_key_iv: "9c646bebf7b52714b488a17d2cfd2796"
server_key_version: "encryptionkey@0"
I20260923 19:40:27.194410 31129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:27.207180 31129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:27.211436 31129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:27.211747 31129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:27.231014 31129 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:39035
I20260923 19:40:27.231034 31195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:39035 every 8 connection(s)
I20260923 19:40:27.232427 31129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:27.232748 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 31129
I20260923 19:40:27.232965 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:27.233556 12927 external_mini_cluster.cc:1428] Setting key 41e91f96caf7074c990b7cff9e1a15d9
I20260923 19:40:27.237011 31196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:40:27 dist-test-slave-lzv7 krb5kdc[31116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:27.250998 31196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204: Bootstrap starting.
I20260923 19:40:27.254268 31196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:27.255326 31196 log.cc:824] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:27.258339 31199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:27.235740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40428 (local address 127.12.159.254:39035)
0923 19:40:27.236578 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:27.236593 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:27.236649 (+ 56us) server_negotiation.cc:407] Connection header received
0923 19:40:27.238518 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:27.238541 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:27.238932 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:27.239281 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:27.241220 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:27.242770 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:27.244727 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:27.245513 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:27.245665 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:27.250717 (+ 5052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:27.250725 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:27.250740 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:27.250787 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:27.253994 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:27.254794 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:27.254802 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:27.254808 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:27.254984 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:27.255374 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:27.255380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:27.255384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:27.256059 (+ 675us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:27.256393 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:27.256853 (+ 460us) server_negotiation.cc:299] Negotiation successful
0923 19:40:27.257307 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":397,"threads_started":1}
I20260923 19:40:27.258436 31196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204: No bootstrap required, opened a new log
I20260923 19:40:27.266398 31196 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f77b82c2476473681e2f92723d01204" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39035 } }
I20260923 19:40:27.266819 31196 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:27.266935 31196 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f77b82c2476473681e2f92723d01204, State: Initialized, Role: FOLLOWER
I20260923 19:40:27.267625 31196 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f77b82c2476473681e2f92723d01204" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39035 } }
I20260923 19:40:27.267930 31196 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:27.268075 31196 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:27.268258 31196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:27.270515 31196 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f77b82c2476473681e2f92723d01204" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39035 } }
I20260923 19:40:27.271020 31196 leader_election.cc:302] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f77b82c2476473681e2f92723d01204; no voters:
I20260923 19:40:27.271632 31196 leader_election.cc:288] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:27.271776 31201 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:27.272470 31201 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [term 1 LEADER]: Becoming Leader. State: Replica: 2f77b82c2476473681e2f92723d01204, State: Running, Role: LEADER
I20260923 19:40:27.273087 31201 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f77b82c2476473681e2f92723d01204" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39035 } }
I20260923 19:40:27.273762 31196 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:27.276234 31203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f77b82c2476473681e2f92723d01204. Latest consensus state: current_term: 1 leader_uuid: "2f77b82c2476473681e2f92723d01204" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f77b82c2476473681e2f92723d01204" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39035 } } }
I20260923 19:40:27.276175 31202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f77b82c2476473681e2f92723d01204" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f77b82c2476473681e2f92723d01204" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 39035 } } }
I20260923 19:40:27.276607 31202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:27.276607 31203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:27.278913 31207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:27.284264 31207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:27.292891 31207 catalog_manager.cc:1347] Generated new cluster ID: 3075f8ddc41947b2abc5601010c5195c
I20260923 19:40:27.293005 31207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:27.314905 31207 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:27.316681 31207 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:27.326140 31207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204: Generated new TSK 0
I20260923 19:40:27.327044 31207 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:40:27.397452 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39035
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:45945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:27.771291 31222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:27.771603 31222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:27.771705 31222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:27.779556 31222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:27.779666 31222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:27.779779 31222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:40:27.789767 31222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39035
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:27.791070 31222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:27.792320 31222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:27.807415 31227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:27.807435 31230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:27.807358 31228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:27.811599 31222 server_base.cc:1034] running on GCE node
I20260923 19:40:27.812288 31222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:27.813341 31222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:27.814589 31222 hybrid_clock.cc:648] HybridClock initialized: now 1790192427814514 us; error 64 us; skew 500 ppm
I20260923 19:40:27.814962 31222 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:27 dist-test-slave-lzv7 krb5kdc[31116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192427, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:27.818357 31222 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:40:27.819901 31222 webserver.cc:460] Webserver started at http://127.12.159.193:33429/ using document root <none> and password file <none>
I20260923 19:40:27.820639 31222 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:27.820783 31222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:27.821100 31222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:27.824100 31222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "ca3b34dce6b3404e8e7c87a32b274a05"
format_stamp: "Formatted at 2026-09-23 19:40:27 on dist-test-slave-lzv7"
server_key: "08579e43a93cbf8673fafbb5fb3c2592"
server_key_iv: "1c21badb51f32d7efda8abab8cd1e667"
server_key_version: "encryptionkey@0"
I20260923 19:40:27.824935 31222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "ca3b34dce6b3404e8e7c87a32b274a05"
format_stamp: "Formatted at 2026-09-23 19:40:27 on dist-test-slave-lzv7"
server_key: "08579e43a93cbf8673fafbb5fb3c2592"
server_key_iv: "1c21badb51f32d7efda8abab8cd1e667"
server_key_version: "encryptionkey@0"
I20260923 19:40:27.830669 31222 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:40:27.834409 31237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:27.842294 31222 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.004s sys 0.001s
I20260923 19:40:27.842546 31222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "ca3b34dce6b3404e8e7c87a32b274a05"
format_stamp: "Formatted at 2026-09-23 19:40:27 on dist-test-slave-lzv7"
server_key: "08579e43a93cbf8673fafbb5fb3c2592"
server_key_iv: "1c21badb51f32d7efda8abab8cd1e667"
server_key_version: "encryptionkey@0"
I20260923 19:40:27.842885 31222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:27.869042 31222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:27.875039 31222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:27.875396 31222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:27.876540 31222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:27.877964 31222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:27.878036 31222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:27.878149 31222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:27.878244 31222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:27.910684 31222 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:34461
I20260923 19:40:27.910720 31349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:34461 every 8 connection(s)
I20260923 19:40:27.911991 31222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:40:27.922019 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 31222
I20260923 19:40:27.922192 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:40:27.922655 12927 external_mini_cluster.cc:1428] Setting key 227db469831695ac59d0d19fd1160fb8
Sep 23 19:40:27 dist-test-slave-lzv7 krb5kdc[31116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192427, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:27.934007 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:27.914565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:59277 (local address 127.12.159.254:39035)
0923 19:40:27.914995 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:27.914999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:27.916222 (+ 1223us) server_negotiation.cc:407] Connection header received
0923 19:40:27.918277 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:27.918282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:27.918376 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:27.918500 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:27.920027 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:27.920765 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:27.922556 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:27.923012 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:27.923159 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:27.927253 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:27.927262 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:27.927270 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:27.927317 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:27.930857 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:27.931619 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:27.931627 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:27.931634 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:27.931782 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:27.932207 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:27.932215 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:27.932225 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:27.932625 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:27.932779 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:27.933488 (+ 709us) server_negotiation.cc:299] Negotiation successful
0923 19:40:27.933683 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":216,"threads_started":1}
I20260923 19:40:27.935290 31353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:27.915151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39035 (local address 127.12.159.193:59277)
0923 19:40:27.916019 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:27.916080 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:27.917988 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:27.918759 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:27.918767 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:27.919283 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:27.919848 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:27.919865 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:27.920925 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:27.920931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:27.922416 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:27.922429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:27.923256 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:27.923266 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:27.923568 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:27.924329 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:27.924356 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:27.927008 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:27.931007 (+ 3999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:27.931014 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:27.931028 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:27.931468 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:27.931886 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:27.931889 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:27.931891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:27.932086 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:27.932742 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:27.932748 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:27.933090 (+ 342us) client_negotiation.cc:769] Sending connection context
0923 19:40:27.933316 (+ 226us) client_negotiation.cc:240] Negotiation successful
0923 19:40:27.933944 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":279,"threads_started":1}
I20260923 19:40:27.936981 31350 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39035
I20260923 19:40:27.937295 31350 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:27.938094 31350 heartbeater.cc:511] Master 127.12.159.254:39035 requested a full tablet report, sending...
I20260923 19:40:27.940094 31161 ts_manager.cc:194] Registered new tserver with Master: ca3b34dce6b3404e8e7c87a32b274a05 (127.12.159.193:34461)
I20260923 19:40:27.941534 31161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:59277
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:40:27.981340 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39035
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:45945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:28.312261 31356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:28.312599 31356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:28.312772 31356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:28.320190 31356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:28.320356 31356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:28.320551 31356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:40:28.330614 31356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39035
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:28.331912 31356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:28.333225 31356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:28.346827 31361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:28.346793 31364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:28.346869 31362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:28.347993 31356 server_base.cc:1034] running on GCE node
I20260923 19:40:28.348665 31356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:28.349728 31356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:28.350971 31356 hybrid_clock.cc:648] HybridClock initialized: now 1790192428350879 us; error 46 us; skew 500 ppm
I20260923 19:40:28.351269 31356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:28 dist-test-slave-lzv7 krb5kdc[31116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192428, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:28.354529 31356 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:40:28.356128 31356 webserver.cc:460] Webserver started at http://127.12.159.194:44859/ using document root <none> and password file <none>
I20260923 19:40:28.356788 31356 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:28.356899 31356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:28.357203 31356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:28.360173 31356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "22d7d22a5d80463b84dc0619a7ffd1a8"
format_stamp: "Formatted at 2026-09-23 19:40:28 on dist-test-slave-lzv7"
server_key: "45f9626abb9355b6c1cec11e28ac3d98"
server_key_iv: "33ad960e6d30fff861e946c44f72bad1"
server_key_version: "encryptionkey@0"
I20260923 19:40:28.360941 31356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "22d7d22a5d80463b84dc0619a7ffd1a8"
format_stamp: "Formatted at 2026-09-23 19:40:28 on dist-test-slave-lzv7"
server_key: "45f9626abb9355b6c1cec11e28ac3d98"
server_key_iv: "33ad960e6d30fff861e946c44f72bad1"
server_key_version: "encryptionkey@0"
I20260923 19:40:28.366214 31356 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260923 19:40:28.369503 31371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:28.370919 31356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:40:28.371145 31356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "22d7d22a5d80463b84dc0619a7ffd1a8"
format_stamp: "Formatted at 2026-09-23 19:40:28 on dist-test-slave-lzv7"
server_key: "45f9626abb9355b6c1cec11e28ac3d98"
server_key_iv: "33ad960e6d30fff861e946c44f72bad1"
server_key_version: "encryptionkey@0"
I20260923 19:40:28.371340 31356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:28.390514 31356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:28.395074 31356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:28.395390 31356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:28.396416 31356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:28.397881 31356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:28.397974 31356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:28.398130 31356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:28.398200 31356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:28.431461 31356 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:33485
I20260923 19:40:28.431509 31483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:33485 every 8 connection(s)
I20260923 19:40:28.432803 31356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:40:28.435187 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 31356
I20260923 19:40:28.435389 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:40:28.436017 12927 external_mini_cluster.cc:1428] Setting key 6fd3484091b97f9cebe4eb34028617b2
Sep 23 19:40:28 dist-test-slave-lzv7 krb5kdc[31116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192428, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:28.454581 31486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:28.435427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:51747 (local address 127.12.159.254:39035)
0923 19:40:28.435931 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:28.435938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:28.437086 (+ 1148us) server_negotiation.cc:407] Connection header received
0923 19:40:28.439056 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:28.439061 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:28.439147 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:28.439278 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:28.440756 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.441485 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.443113 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.443557 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.443694 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:28.448253 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:28.448258 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:28.448261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:28.448295 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:28.451128 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:28.452136 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:28.452140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:28.452142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:28.452262 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:28.452787 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:28.452791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:28.452793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:28.453085 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:28.453206 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:28.454141 (+ 935us) server_negotiation.cc:299] Negotiation successful
0923 19:40:28.454309 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":478,"threads_started":1}
I20260923 19:40:28.456192 31487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:28.436048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39035 (local address 127.12.159.194:51747)
0923 19:40:28.436924 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:28.436976 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:28.438785 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:28.439520 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:28.439528 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:28.440030 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:28.440588 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:28.440605 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.441637 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.441656 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:28.442959 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:28.442971 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.443785 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.443791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:28.444026 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:28.444774 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:28.444818 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:28.447871 (+ 3053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:28.451286 (+ 3415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:28.451299 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:28.451322 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:28.451992 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:28.452377 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:28.452385 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:28.452391 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:28.452669 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:28.453227 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:28.453238 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:28.453722 (+ 484us) client_negotiation.cc:769] Sending connection context
0923 19:40:28.454051 (+ 329us) client_negotiation.cc:240] Negotiation successful
0923 19:40:28.454661 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":355,"threads_started":1}
I20260923 19:40:28.457785 31484 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39035
I20260923 19:40:28.458171 31484 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:28.459143 31484 heartbeater.cc:511] Master 127.12.159.254:39035 requested a full tablet report, sending...
I20260923 19:40:28.460808 31161 ts_manager.cc:194] Registered new tserver with Master: 22d7d22a5d80463b84dc0619a7ffd1a8 (127.12.159.194:33485)
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
I20260923 19:40:28.461843 31161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:51747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:40:28.494172 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39035
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:45945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:28.841325 31490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:28.841679 31490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:28.841915 31490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:28.849968 31490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:28.850087 31490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:28.850289 31490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:40:28.860569 31490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:39035
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:28.862082 31490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:28.863435 31490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:28.879189 31495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:28.879200 31496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:28.879225 31498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:28.880493 31490 server_base.cc:1034] running on GCE node
I20260923 19:40:28.881150 31490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:28.882246 31490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:28.883502 31490 hybrid_clock.cc:648] HybridClock initialized: now 1790192428883452 us; error 46 us; skew 500 ppm
I20260923 19:40:28.883870 31490 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:28 dist-test-slave-lzv7 krb5kdc[31116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192428, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:28.887302 31490 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:40:28.888756 31490 webserver.cc:460] Webserver started at http://127.12.159.195:40321/ using document root <none> and password file <none>
I20260923 19:40:28.889462 31490 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:28.889642 31490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:28.890125 31490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:28.893087 31490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "ea2bc3e1947f4de88d297d8d5a714ae7"
format_stamp: "Formatted at 2026-09-23 19:40:28 on dist-test-slave-lzv7"
server_key: "e0457c070466744c3968aaae6af2f05a"
server_key_iv: "9f74c8d4375889071af126c3edc58fa6"
server_key_version: "encryptionkey@0"
I20260923 19:40:28.893988 31490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "ea2bc3e1947f4de88d297d8d5a714ae7"
format_stamp: "Formatted at 2026-09-23 19:40:28 on dist-test-slave-lzv7"
server_key: "e0457c070466744c3968aaae6af2f05a"
server_key_iv: "9f74c8d4375889071af126c3edc58fa6"
server_key_version: "encryptionkey@0"
I20260923 19:40:28.899288 31490 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260923 19:40:28.902971 31505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:28.904300 31490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:40:28.904474 31490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "ea2bc3e1947f4de88d297d8d5a714ae7"
format_stamp: "Formatted at 2026-09-23 19:40:28 on dist-test-slave-lzv7"
server_key: "e0457c070466744c3968aaae6af2f05a"
server_key_iv: "9f74c8d4375889071af126c3edc58fa6"
server_key_version: "encryptionkey@0"
I20260923 19:40:28.904686 31490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:28.919965 31490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:28.923920 31490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:28.924213 31490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:28.925199 31490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:28.926585 31490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:28.926685 31490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:28.926833 31490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:28.926908 31490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:28.944621 31350 heartbeater.cc:503] Master 127.12.159.254:39035 was elected leader, sending a full tablet report...
I20260923 19:40:28.960525 31490 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:40991
I20260923 19:40:28.960616 31617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:40991 every 8 connection(s)
I20260923 19:40:28.962000 31490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:40:28.970166 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 31490
I20260923 19:40:28.970355 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:40:28.970805 12927 external_mini_cluster.cc:1428] Setting key ca6f562d2e4c5e661342808440d8da70
Sep 23 19:40:28 dist-test-slave-lzv7 krb5kdc[31116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192428, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:28.982115 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:28.964427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:55383 (local address 127.12.159.254:39035)
0923 19:40:28.964916 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:28.964921 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:28.965753 (+ 832us) server_negotiation.cc:407] Connection header received
0923 19:40:28.967657 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:28.967663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:28.967765 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:28.967882 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:28.969343 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.970377 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.972210 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.972677 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.972823 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:28.976563 (+ 3740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:28.976568 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:28.976571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:28.976604 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:28.979106 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:28.979869 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:28.979873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:28.979875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:28.979993 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:28.980419 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:28.980423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:28.980425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:28.980726 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:28.980858 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:28.981556 (+ 698us) server_negotiation.cc:299] Negotiation successful
0923 19:40:28.981745 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":261,"threads_started":1}
I20260923 19:40:28.983078 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:28.964852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:39035 (local address 127.12.159.195:55383)
0923 19:40:28.965598 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:28.965635 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:28.967389 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:28.968124 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:28.968132 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:28.968626 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:28.969181 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:28.969199 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.970552 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.970557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:28.972082 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:28.972094 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:28.972919 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:28.972925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:28.973131 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:28.973926 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:28.973950 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:28.976350 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:28.979231 (+ 2881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:28.979239 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:28.979251 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:28.979711 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:28.980103 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:28.980106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:28.980109 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:28.980292 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:28.980850 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:28.980856 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:28.981198 (+ 342us) client_negotiation.cc:769] Sending connection context
0923 19:40:28.981434 (+ 236us) client_negotiation.cc:240] Negotiation successful
0923 19:40:28.981908 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":319,"threads_started":1}
I20260923 19:40:28.984724 31618 heartbeater.cc:347] Connected to a master server at 127.12.159.254:39035
I20260923 19:40:28.985093 31618 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:28.985986 31618 heartbeater.cc:511] Master 127.12.159.254:39035 requested a full tablet report, sending...
I20260923 19:40:28.987452 31161 ts_manager.cc:194] Registered new tserver with Master: ea2bc3e1947f4de88d297d8d5a714ae7 (127.12.159.195:40991)
I20260923 19:40:28.988288 31161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:55383
I20260923 19:40:28.998768 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:40:29.016497 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.002981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44142 (local address 127.12.159.254:39035)
0923 19:40:29.003227 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.003236 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.003645 (+ 409us) server_negotiation.cc:407] Connection header received
0923 19:40:29.003788 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.003792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.003866 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.003950 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:29.005529 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.006317 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.007692 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.008075 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.008233 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.011083 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:29.011088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:29.011091 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:29.011126 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:29.013596 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.014393 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.014400 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.014409 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.014524 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.014978 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.014982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.014986 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.015307 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:29.015580 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.015984 (+ 404us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.016194 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260923 19:40:29.020531 31161 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:40:29.027516 31161 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:40:29.076279 31633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.040202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:33485 (local address 127.0.0.1:58184)
0923 19:40:29.066553 (+ 26351us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:29.066685 (+ 132us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:29.066900 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:29.068458 (+ 1558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:29.068462 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:29.068498 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:29.069108 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.069120 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.071225 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.071231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.073369 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.073382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.075091 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.075097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.075299 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.075404 (+ 105us) client_negotiation.cc:769] Sending connection context
0923 19:40:29.075565 (+ 161us) client_negotiation.cc:240] Negotiation successful
0923 19:40:29.075773 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26006,"mutex_wait_us":174,"spinlock_wait_cycles":32256,"thread_start_us":26085,"threads_started":1}
I20260923 19:40:29.076905 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.041121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.12.159.195:40991)
0923 19:40:29.065659 (+ 24538us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.065666 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.067037 (+ 1371us) server_negotiation.cc:407] Connection header received
0923 19:40:29.067739 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.067747 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.067923 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.068119 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:29.069662 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.071184 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.073962 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.075538 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.075683 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.075795 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.076419 (+ 624us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.076587 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24352,"thread_start_us":24547,"threads_started":1}
I20260923 19:40:29.076938 31631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.040573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:40991 (local address 127.0.0.1:51134)
0923 19:40:29.066553 (+ 25980us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:29.066664 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:29.066900 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:29.068434 (+ 1534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:29.068443 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:29.068536 (+ 93us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:29.069440 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.069451 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.071364 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.071372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.073739 (+ 2367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.073754 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.076008 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.076012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.076139 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.076159 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 19:40:29.076371 (+ 212us) client_negotiation.cc:240] Negotiation successful
0923 19:40:29.076507 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25848,"mutex_wait_us":112,"spinlock_wait_cycles":107520,"thread_start_us":25510,"threads_started":1}
I20260923 19:40:29.077369 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.040388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58184 (local address 127.12.159.194:33485)
0923 19:40:29.067480 (+ 27092us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.067489 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.067516 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:40:29.067624 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.067631 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.067922 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.068244 (+ 322us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:29.069317 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.071001 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.073522 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.074893 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.075072 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.075325 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.076794 (+ 1469us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.076967 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26915,"thread_start_us":26812,"threads_started":1}
I20260923 19:40:29.078908 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.040833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:34461 (local address 127.0.0.1:56726)
0923 19:40:29.067320 (+ 26487us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:29.067341 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:29.067465 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:29.068434 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:29.068443 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:29.068530 (+ 87us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:29.069411 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.069432 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.072383 (+ 2951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.072389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.075417 (+ 3028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.075431 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.078127 (+ 2696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.078133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.078292 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.078330 (+ 38us) client_negotiation.cc:769] Sending connection context
0923 19:40:29.078413 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 19:40:29.078544 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26346,"mutex_wait_us":30,"spinlock_wait_cycles":7680,"thread_start_us":25777,"threads_started":1}
I20260923 19:40:29.080739 31419 tablet_service.cc:1467] Processing CreateTablet for tablet a488ac5929f446a89e8741eb03bea4a8 (DEFAULT_TABLE table=test-table [id=d8bbaf9defb44e529f66a8f5f122eca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:29.080740 31553 tablet_service.cc:1467] Processing CreateTablet for tablet a488ac5929f446a89e8741eb03bea4a8 (DEFAULT_TABLE table=test-table [id=d8bbaf9defb44e529f66a8f5f122eca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:29.082003 31419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a488ac5929f446a89e8741eb03bea4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:29.082379 31553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a488ac5929f446a89e8741eb03bea4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:29.082854 31636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.041488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56726 (local address 127.12.159.193:34461)
0923 19:40:29.065579 (+ 24091us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.065590 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.067491 (+ 1901us) server_negotiation.cc:407] Connection header received
0923 19:40:29.067621 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.067629 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.067917 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.068119 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:29.069647 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.072222 (+ 2575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.075611 (+ 3389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.077912 (+ 2301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.078128 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.082251 (+ 4123us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.082343 (+ 92us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.082532 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23863,"thread_start_us":24123,"threads_started":1}
I20260923 19:40:29.091388 31285 tablet_service.cc:1467] Processing CreateTablet for tablet a488ac5929f446a89e8741eb03bea4a8 (DEFAULT_TABLE table=test-table [id=d8bbaf9defb44e529f66a8f5f122eca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:29.093045 31285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a488ac5929f446a89e8741eb03bea4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:29.095085 31637 tablet_bootstrap.cc:492] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Bootstrap starting.
I20260923 19:40:29.098542 31637 tablet_bootstrap.cc:654] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:29.098701 31638 tablet_bootstrap.cc:492] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Bootstrap starting.
I20260923 19:40:29.100025 31637 log.cc:824] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:29.102376 31638 tablet_bootstrap.cc:654] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:29.103657 31638 log.cc:824] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:29.103885 31637 tablet_bootstrap.cc:492] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: No bootstrap required, opened a new log
I20260923 19:40:29.104193 31637 ts_tablet_manager.cc:1397] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:40:29.107000 31638 tablet_bootstrap.cc:492] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: No bootstrap required, opened a new log
I20260923 19:40:29.107283 31638 ts_tablet_manager.cc:1397] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:40:29.108243 31641 tablet_bootstrap.cc:492] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Bootstrap starting.
I20260923 19:40:29.111974 31641 tablet_bootstrap.cc:654] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:29.113085 31641 log.cc:824] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:29.114962 31637 raft_consensus.cc:348] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.115450 31637 raft_consensus.cc:374] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:29.115545 31637 raft_consensus.cc:729] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea2bc3e1947f4de88d297d8d5a714ae7, State: Initialized, Role: FOLLOWER
I20260923 19:40:29.116086 31641 tablet_bootstrap.cc:492] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: No bootstrap required, opened a new log
I20260923 19:40:29.116366 31641 ts_tablet_manager.cc:1397] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260923 19:40:29.116227 31637 consensus_queue.cc:260] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.117424 31618 heartbeater.cc:503] Master 127.12.159.254:39035 was elected leader, sending a full tablet report...
I20260923 19:40:29.118130 31637 ts_tablet_manager.cc:1428] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260923 19:40:29.119436 31638 raft_consensus.cc:348] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.119827 31638 raft_consensus.cc:374] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:29.119948 31638 raft_consensus.cc:729] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22d7d22a5d80463b84dc0619a7ffd1a8, State: Initialized, Role: FOLLOWER
I20260923 19:40:29.120558 31638 consensus_queue.cc:260] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.121636 31484 heartbeater.cc:503] Master 127.12.159.254:39035 was elected leader, sending a full tablet report...
I20260923 19:40:29.122431 31638 ts_tablet_manager.cc:1428] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
I20260923 19:40:29.125881 31641 raft_consensus.cc:348] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.126264 31641 raft_consensus.cc:374] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:29.126358 31641 raft_consensus.cc:729] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca3b34dce6b3404e8e7c87a32b274a05, State: Initialized, Role: FOLLOWER
I20260923 19:40:29.127002 31641 consensus_queue.cc:260] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.128525 31641 ts_tablet_manager.cc:1428] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
W20260923 19:40:29.164471 31351 tablet.cc:2369] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:40:29.185043 31485 tablet.cc:2369] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:40:29.196647 31645 raft_consensus.cc:482] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:40:29.197037 31645 raft_consensus.cc:504] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.199329 31645 leader_election.cc:288] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22d7d22a5d80463b84dc0619a7ffd1a8 (127.12.159.194:33485), ea2bc3e1947f4de88d297d8d5a714ae7 (127.12.159.195:40991)
I20260923 19:40:29.208386 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.200140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:47613 (local address 127.12.159.195:40991)
0923 19:40:29.200394 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.200401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.200885 (+ 484us) server_negotiation.cc:407] Connection header received
0923 19:40:29.201078 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.201083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.201158 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.201276 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:29.201942 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.203024 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.205853 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.207134 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.207318 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.207397 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.207972 (+ 575us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.208115 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:40:29.208668 31647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.199651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:40991 (local address 127.12.159.193:47613)
0923 19:40:29.200784 (+ 1133us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:29.200796 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:29.200912 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:29.201299 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:29.201304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:29.201328 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:29.201759 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.201768 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.203181 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.203193 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.205612 (+ 2419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.205630 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.207468 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.207476 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.207742 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.207822 (+ 80us) client_negotiation.cc:769] Sending connection context
0923 19:40:29.207915 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 19:40:29.208119 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1010,"mutex_wait_us":201,"thread_start_us":775,"threads_started":1}
I20260923 19:40:29.208693 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.199504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:33485 (local address 127.12.159.193:47877)
0923 19:40:29.200400 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:29.200429 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:29.200619 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:29.201030 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:29.201067 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:29.201101 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:29.201465 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.201478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.202935 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.202938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.205612 (+ 2674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:29.205630 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.207479 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.207484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:29.207726 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.207813 (+ 87us) client_negotiation.cc:769] Sending connection context
0923 19:40:29.207915 (+ 102us) client_negotiation.cc:240] Negotiation successful
0923 19:40:29.208135 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":163,"thread_start_us":559,"threads_started":1}
I20260923 19:40:29.208810 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.199715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:47877 (local address 127.12.159.194:33485)
0923 19:40:29.199917 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.199924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.200550 (+ 626us) server_negotiation.cc:407] Connection header received
0923 19:40:29.200773 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.200777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.200888 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.201015 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:29.201622 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.202799 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.205853 (+ 3054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.207164 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.207318 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.207397 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.208029 (+ 632us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.208174 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 19:40:29.209954 31439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a488ac5929f446a89e8741eb03bea4a8" candidate_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" is_pre_election: true
I20260923 19:40:29.209954 31573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a488ac5929f446a89e8741eb03bea4a8" candidate_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" is_pre_election: true
I20260923 19:40:29.210541 31573 raft_consensus.cc:2454] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca3b34dce6b3404e8e7c87a32b274a05 in term 0.
I20260923 19:40:29.210541 31439 raft_consensus.cc:2454] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca3b34dce6b3404e8e7c87a32b274a05 in term 0.
I20260923 19:40:29.211258 31239 leader_election.cc:302] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22d7d22a5d80463b84dc0619a7ffd1a8, ca3b34dce6b3404e8e7c87a32b274a05; no voters:
I20260923 19:40:29.211772 31645 raft_consensus.cc:2781] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:40:29.211938 31645 raft_consensus.cc:482] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:40:29.212056 31645 raft_consensus.cc:3037] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:40:29.213653 31619 tablet.cc:2369] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:40:29.214815 31645 raft_consensus.cc:504] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.215385 31645 leader_election.cc:288] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [CANDIDATE]: Term 1 election: Requested vote from peers 22d7d22a5d80463b84dc0619a7ffd1a8 (127.12.159.194:33485), ea2bc3e1947f4de88d297d8d5a714ae7 (127.12.159.195:40991)
I20260923 19:40:29.215993 31439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a488ac5929f446a89e8741eb03bea4a8" candidate_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8"
I20260923 19:40:29.216042 31573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a488ac5929f446a89e8741eb03bea4a8" candidate_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7"
I20260923 19:40:29.216256 31573 raft_consensus.cc:3037] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:29.216256 31439 raft_consensus.cc:3037] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:29.219756 31439 raft_consensus.cc:2454] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca3b34dce6b3404e8e7c87a32b274a05 in term 1.
I20260923 19:40:29.219756 31573 raft_consensus.cc:2454] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca3b34dce6b3404e8e7c87a32b274a05 in term 1.
I20260923 19:40:29.220304 31239 leader_election.cc:302] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 22d7d22a5d80463b84dc0619a7ffd1a8, ca3b34dce6b3404e8e7c87a32b274a05, ea2bc3e1947f4de88d297d8d5a714ae7; no voters:
I20260923 19:40:29.220670 31645 raft_consensus.cc:2781] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:29.221130 31645 raft_consensus.cc:686] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 1 LEADER]: Becoming Leader. State: Replica: ca3b34dce6b3404e8e7c87a32b274a05, State: Running, Role: LEADER
I20260923 19:40:29.221706 31645 consensus_queue.cc:237] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } }
I20260923 19:40:29.226442 31160 catalog_manager.cc:5495] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca3b34dce6b3404e8e7c87a32b274a05 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca3b34dce6b3404e8e7c87a32b274a05" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 34461 } health_report { overall_health: HEALTHY } } }
I20260923 19:40:29.277715 31636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.272061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56732 (local address 127.12.159.193:34461)
0923 19:40:29.272244 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.272248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.272268 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:40:29.272494 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.272498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.272592 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.272720 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:40:29.273123 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.274094 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.275620 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.276015 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.276122 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.276610 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:40:29.277163 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:40:29.277300 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.277452 (+ 152us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.277493 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 19:40:29.286216 31439 raft_consensus.cc:1261] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 1 FOLLOWER]: Refusing update from remote peer ca3b34dce6b3404e8e7c87a32b274a05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:29.286217 31573 raft_consensus.cc:1261] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 1 FOLLOWER]: Refusing update from remote peer ca3b34dce6b3404e8e7c87a32b274a05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:29.287216 31645 consensus_queue.cc:1035] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22d7d22a5d80463b84dc0619a7ffd1a8" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:29.287514 31648 consensus_queue.cc:1035] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea2bc3e1947f4de88d297d8d5a714ae7" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 40991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:29.303766 31653 mvcc.cc:205] Tried to move back new op lower bound from 7332628190346121216 to 7332628190096515072. Current Snapshot: MvccSnapshot[applied={T|T < 7332628190346121216}]
I20260923 19:40:29.312929 31160 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:29.313237 31160 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:29.316731 31160 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f77b82c2476473681e2f92723d01204: Sending DeleteTablet for 3 replicas of tablet a488ac5929f446a89e8741eb03bea4a8
I20260923 19:40:29.317934 31419 tablet_service.cc:1514] Processing DeleteTablet for tablet a488ac5929f446a89e8741eb03bea4a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:29 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:58184
I20260923 19:40:29.317955 31553 tablet_service.cc:1514] Processing DeleteTablet for tablet a488ac5929f446a89e8741eb03bea4a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:29 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51134
I20260923 19:40:29.318317 31285 tablet_service.cc:1514] Processing DeleteTablet for tablet a488ac5929f446a89e8741eb03bea4a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:29 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:56726
I20260923 19:40:29.323740 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 31222
I20260923 19:40:29.333206 31661 tablet_replica.cc:330] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: stopping tablet replica
I20260923 19:40:29.333735 31661 raft_consensus.cc:2229] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:29.334360 31661 raft_consensus.cc:2258] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:29.335191 31662 tablet_replica.cc:330] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: stopping tablet replica
I20260923 19:40:29.335626 31662 raft_consensus.cc:2229] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:29.336114 31662 raft_consensus.cc:2258] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:29.338439 31662 ts_tablet_manager.cc:1905] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:29.339231 31663 tablet_replica.cc:330] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: stopping tablet replica
I20260923 19:40:29.339855 31663 raft_consensus.cc:2229] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:40:29.341557 31661 ts_tablet_manager.cc:1905] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:29.342391 31663 raft_consensus.cc:2258] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:29.346529 31662 ts_tablet_manager.cc:1918] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:29.346735 31662 log.cc:1196] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/a488ac5929f446a89e8741eb03bea4a8
I20260923 19:40:29.348714 31663 ts_tablet_manager.cc:1905] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:40:29 dist-test-slave-lzv7 krb5kdc[31116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:40:29.351177 31661 ts_tablet_manager.cc:1918] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:29.351475 31661 log.cc:1196] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/a488ac5929f446a89e8741eb03bea4a8
I20260923 19:40:29.352134 31661 ts_tablet_manager.cc:1939] T a488ac5929f446a89e8741eb03bea4a8 P ea2bc3e1947f4de88d297d8d5a714ae7: Deleting consensus metadata
I20260923 19:40:29.354475 31148 catalog_manager.cc:4841] TS ea2bc3e1947f4de88d297d8d5a714ae7 (127.12.159.195:40991): tablet a488ac5929f446a89e8741eb03bea4a8 (table test-table [id=d8bbaf9defb44e529f66a8f5f122eca9]) successfully deleted
I20260923 19:40:29.355261 31662 ts_tablet_manager.cc:1939] T a488ac5929f446a89e8741eb03bea4a8 P 22d7d22a5d80463b84dc0619a7ffd1a8: Deleting consensus metadata
I20260923 19:40:29.357245 31146 catalog_manager.cc:4841] TS 22d7d22a5d80463b84dc0619a7ffd1a8 (127.12.159.194:33485): tablet a488ac5929f446a89e8741eb03bea4a8 (table test-table [id=d8bbaf9defb44e529f66a8f5f122eca9]) successfully deleted
I20260923 19:40:29.359727 31636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.325390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56738 (local address 127.12.159.193:34461)
0923 19:40:29.325630 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.325640 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.338389 (+ 12749us) server_negotiation.cc:407] Connection header received
0923 19:40:29.338710 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.338717 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.338837 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.338961 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:29.341008 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.342261 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.344777 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.345526 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.345640 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.352093 (+ 6453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:29.352117 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:29.352139 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:29.352206 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:29.356232 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.357229 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.357241 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.357244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.357453 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.357973 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.357978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.357982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.358376 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:29.358705 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.359054 (+ 349us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.359304 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:40:29.359760 31663 ts_tablet_manager.cc:1918] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:29.359931 31663 log.cc:1196] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/a488ac5929f446a89e8741eb03bea4a8
I20260923 19:40:29.360651 31663 ts_tablet_manager.cc:1939] T a488ac5929f446a89e8741eb03bea4a8 P ca3b34dce6b3404e8e7c87a32b274a05: Deleting consensus metadata
I20260923 19:40:29.360744 31345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:29.462970 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 31222
I20260923 19:40:29.464716 31145 catalog_manager.cc:4841] TS ca3b34dce6b3404e8e7c87a32b274a05 (127.12.159.193:34461): tablet a488ac5929f446a89e8741eb03bea4a8 (table test-table [id=d8bbaf9defb44e529f66a8f5f122eca9]) successfully deleted
I20260923 19:40:29.483862 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 31356
Sep 23 19:40:29 dist-test-slave-lzv7 krb5kdc[31116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:40:29.501343 31632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.484714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58192 (local address 127.12.159.194:33485)
0923 19:40:29.484903 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.484911 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.484995 (+ 84us) server_negotiation.cc:407] Connection header received
0923 19:40:29.485225 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.485232 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.485304 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.485421 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:29.486989 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.487765 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.489052 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.489461 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.489598 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.494924 (+ 5326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:29.494944 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:29.494961 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:29.495003 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:29.498273 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.499060 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.499069 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.499071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.499200 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.499583 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.499588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.499598 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.499978 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:29.500294 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.500594 (+ 300us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.500809 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:40:29.502070 31479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:29.595871 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 31356
I20260923 19:40:29.613358 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 31490
Sep 23 19:40:29 dist-test-slave-lzv7 krb5kdc[31116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:40:29.629456 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:29.614247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.12.159.195:40991)
0923 19:40:29.614450 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:29.614455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:29.614476 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:40:29.614642 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:29.614646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:29.614715 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:29.614802 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:29.616250 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.617014 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.618575 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:29.619098 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:29.619243 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:29.623776 (+ 4533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:29.623791 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:29.623807 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:29.623846 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:29.626661 (+ 2815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.627401 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.627409 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.627411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.627545 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:29.627920 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:29.627926 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:29.627929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:29.628291 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:29.628597 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:29.628900 (+ 303us) server_negotiation.cc:299] Negotiation successful
0923 19:40:29.629120 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:40:29.630228 31613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:29.721141 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 31490
I20260923 19:40:29.737751 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 31129
I20260923 19:40:29.739073 31191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:29.854280 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 31129
2026-09-23T19:40:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4435 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-23T19:40:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:29Z Disabled control of system clock
I20260923 19:40:29.932427 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:46397
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:45547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:46397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:40:30.266177 31672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:30.266489 31672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:30.266574 31672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:30.274055 31672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:30.274206 31672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:30.274268 31672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:30.274365 31672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:30.274417 31672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:30.283783 31672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:46397
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:46397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:30.285156 31672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:30.286916 31672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:30.299331 31677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:30.299259 31678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:30.299300 31680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:30.300248 31672 server_base.cc:1034] running on GCE node
I20260923 19:40:30.301111 31672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:30.302839 31672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:30.304066 31672 hybrid_clock.cc:648] HybridClock initialized: now 1790192430304010 us; error 48 us; skew 500 ppm
I20260923 19:40:30.304486 31672 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:30.307065 31672 webserver.cc:460] Webserver started at http://127.12.159.254:38723/ using document root <none> and password file <none>
I20260923 19:40:30.307806 31672 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:30.307930 31672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:30.308281 31672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:30.311523 31672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "e84dfbade9cd4e29b73415390d22bea8"
format_stamp: "Formatted at 2026-09-23 19:40:30 on dist-test-slave-lzv7"
server_key: "9acd6d1559c9c037e9f4551238ed98c4"
server_key_iv: "16585c3e5ec85751859250439a73928e"
server_key_version: "encryptionkey@0"
I20260923 19:40:30.312772 31672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "e84dfbade9cd4e29b73415390d22bea8"
format_stamp: "Formatted at 2026-09-23 19:40:30 on dist-test-slave-lzv7"
server_key: "9acd6d1559c9c037e9f4551238ed98c4"
server_key_iv: "16585c3e5ec85751859250439a73928e"
server_key_version: "encryptionkey@0"
I20260923 19:40:30.318398 31672 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260923 19:40:30.322077 31686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:30.323657 31672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:40:30.323875 31672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "e84dfbade9cd4e29b73415390d22bea8"
format_stamp: "Formatted at 2026-09-23 19:40:30 on dist-test-slave-lzv7"
server_key: "9acd6d1559c9c037e9f4551238ed98c4"
server_key_iv: "16585c3e5ec85751859250439a73928e"
server_key_version: "encryptionkey@0"
I20260923 19:40:30.324129 31672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:30.336831 31672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:30.337706 31672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:30.338049 31672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:30.357293 31672 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:46397
I20260923 19:40:30.357318 31737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:46397 every 8 connection(s)
I20260923 19:40:30.358749 31672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:30.362722 31738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:30.366271 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 31672
I20260923 19:40:30.366482 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:30.367023 12927 external_mini_cluster.cc:1428] Setting key b0e7473f73e3ea1dc3de7f3812c7b2ee
I20260923 19:40:30.376109 31738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8: Bootstrap starting.
I20260923 19:40:30.379426 31738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:30.380764 31738 log.cc:824] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:30.381646 31741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:30.369056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58820 (local address 127.12.159.254:46397)
0923 19:40:30.370109 (+ 1053us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:30.370120 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:30.370165 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:40:30.371909 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:30.371934 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:30.372458 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:30.372896 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:30.373550 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:30.375311 (+ 1761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:30.376791 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:30.377499 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:30.377713 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:30.378971 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:30.378978 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:30.378993 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:30.379597 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:30.379700 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:30.379725 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:30.379863 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:30.380116 (+ 253us) server_negotiation.cc:299] Negotiation successful
0923 19:40:30.380453 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":341,"threads_started":1}
I20260923 19:40:30.383832 31738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8: No bootstrap required, opened a new log
I20260923 19:40:30.391660 31738 raft_consensus.cc:348] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84dfbade9cd4e29b73415390d22bea8" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46397 } }
I20260923 19:40:30.392052 31738 raft_consensus.cc:374] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:30.392184 31738 raft_consensus.cc:729] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e84dfbade9cd4e29b73415390d22bea8, State: Initialized, Role: FOLLOWER
I20260923 19:40:30.392827 31738 consensus_queue.cc:260] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84dfbade9cd4e29b73415390d22bea8" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46397 } }
I20260923 19:40:30.393069 31738 raft_consensus.cc:388] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:30.393213 31738 raft_consensus.cc:482] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:30.393415 31738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:30.395700 31738 raft_consensus.cc:504] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84dfbade9cd4e29b73415390d22bea8" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46397 } }
I20260923 19:40:30.396238 31738 leader_election.cc:302] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e84dfbade9cd4e29b73415390d22bea8; no voters:
I20260923 19:40:30.396868 31738 leader_election.cc:288] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:30.397029 31743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:30.397722 31743 raft_consensus.cc:686] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [term 1 LEADER]: Becoming Leader. State: Replica: e84dfbade9cd4e29b73415390d22bea8, State: Running, Role: LEADER
I20260923 19:40:30.398231 31743 consensus_queue.cc:237] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84dfbade9cd4e29b73415390d22bea8" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46397 } }
I20260923 19:40:30.398968 31738 sys_catalog.cc:564] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:30.400839 31744 sys_catalog.cc:455] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e84dfbade9cd4e29b73415390d22bea8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84dfbade9cd4e29b73415390d22bea8" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46397 } } }
I20260923 19:40:30.401268 31744 sys_catalog.cc:458] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:30.401129 31745 sys_catalog.cc:455] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e84dfbade9cd4e29b73415390d22bea8. Latest consensus state: current_term: 1 leader_uuid: "e84dfbade9cd4e29b73415390d22bea8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84dfbade9cd4e29b73415390d22bea8" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46397 } } }
I20260923 19:40:30.401609 31745 sys_catalog.cc:458] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:30.405911 31748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:30.411849 31748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:30.421195 31748 catalog_manager.cc:1347] Generated new cluster ID: a99032ad0d2e43c8b370b7b4000d56ca
I20260923 19:40:30.421358 31748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:30.444010 31748 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:30.445395 31748 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:30.451936 31748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8: Generated new TSK 0
I20260923 19:40:30.453008 31748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:30.468514 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46397
--builtin_ntp_servers=127.12.159.212:45547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:40:30.813613 31762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:30.813966 31762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:30.814134 31762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:30.821619 31762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:30.821735 31762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:30.821962 31762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:40:30.831669 31762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:30.833278 31762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:30.835193 31762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:30.848865 31770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:30.848867 31768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:30.849128 31767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:30.849531 31762 server_base.cc:1034] running on GCE node
I20260923 19:40:30.850425 31762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:30.851409 31762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:30.852655 31762 hybrid_clock.cc:648] HybridClock initialized: now 1790192430852605 us; error 43 us; skew 500 ppm
I20260923 19:40:30.852984 31762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:30.855556 31762 webserver.cc:460] Webserver started at http://127.12.159.193:44951/ using document root <none> and password file <none>
I20260923 19:40:30.856357 31762 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:30.856513 31762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:30.856864 31762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:30.860232 31762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "de23c310c3524a1e8198a55d1a04bbf7"
format_stamp: "Formatted at 2026-09-23 19:40:30 on dist-test-slave-lzv7"
server_key: "4af0e5ca3f6e91fdc181b271d14e8374"
server_key_iv: "3978d8b8e07921f94f5074ef87f35b05"
server_key_version: "encryptionkey@0"
I20260923 19:40:30.861140 31762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "de23c310c3524a1e8198a55d1a04bbf7"
format_stamp: "Formatted at 2026-09-23 19:40:30 on dist-test-slave-lzv7"
server_key: "4af0e5ca3f6e91fdc181b271d14e8374"
server_key_iv: "3978d8b8e07921f94f5074ef87f35b05"
server_key_version: "encryptionkey@0"
I20260923 19:40:30.867072 31762 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260923 19:40:30.870983 31776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:30.872584 31762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:40:30.872790 31762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "de23c310c3524a1e8198a55d1a04bbf7"
format_stamp: "Formatted at 2026-09-23 19:40:30 on dist-test-slave-lzv7"
server_key: "4af0e5ca3f6e91fdc181b271d14e8374"
server_key_iv: "3978d8b8e07921f94f5074ef87f35b05"
server_key_version: "encryptionkey@0"
I20260923 19:40:30.873101 31762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:30.901746 31762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:30.902837 31762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:30.903213 31762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:30.904317 31762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:30.906277 31762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:30.906416 31762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:30.906546 31762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:30.906638 31762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:30.943022 31762 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:42157
I20260923 19:40:30.943087 31888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:42157 every 8 connection(s)
I20260923 19:40:30.944463 31762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:40:30.954185 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 31762
I20260923 19:40:30.954370 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:40:30.954946 12927 external_mini_cluster.cc:1428] Setting key 60dacfe01544bbd7ebab985bfb64a95e
I20260923 19:40:30.958370 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46397
--builtin_ntp_servers=127.12.159.212:45547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:40:30.958619 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:30.947200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:58721 (local address 127.12.159.254:46397)
0923 19:40:30.947638 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:30.947643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:30.949000 (+ 1357us) server_negotiation.cc:407] Connection header received
0923 19:40:30.951046 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:30.951052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:30.951150 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:30.951272 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:30.952376 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:30.953066 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:30.955318 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:30.955855 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:30.956060 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:30.957583 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:30.957590 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:30.957595 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:30.957618 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:30.957669 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:30.957687 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:30.957793 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:30.958078 (+ 285us) server_negotiation.cc:299] Negotiation successful
0923 19:40:30.958195 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":216,"threads_started":1}
I20260923 19:40:30.959534 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:30.947907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:46397 (local address 127.12.159.193:58721)
0923 19:40:30.948825 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:30.948875 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:30.950761 (+ 1886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:30.951533 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:30.951542 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:30.951643 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:30.952211 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:30.952227 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:30.953221 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:30.953231 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:30.955164 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:30.955178 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:30.956147 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:30.956156 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:30.956459 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:30.957248 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:30.957251 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:30.957291 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:30.957375 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:30.957796 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:30.957845 (+ 49us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:30.957860 (+ 15us) client_negotiation.cc:769] Sending connection context
0923 19:40:30.958013 (+ 153us) client_negotiation.cc:240] Negotiation successful
0923 19:40:30.958344 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":279,"threads_started":1}
I20260923 19:40:30.961118 31889 heartbeater.cc:347] Connected to a master server at 127.12.159.254:46397
I20260923 19:40:30.961440 31889 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:30.962263 31889 heartbeater.cc:511] Master 127.12.159.254:46397 requested a full tablet report, sending...
I20260923 19:40:30.964561 31703 ts_manager.cc:194] Registered new tserver with Master: de23c310c3524a1e8198a55d1a04bbf7 (127.12.159.193:42157)
I20260923 19:40:30.966854 31703 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.193:58721
W20260923 19:40:31.295853 31893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:31.296124 31893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:31.296211 31893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:31.303670 31893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:31.303828 31893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:31.303982 31893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:40:31.313473 31893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:31.314865 31893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:31.316603 31893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:31.330104 31899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:31.330040 31901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:31.330137 31898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:31.331049 31893 server_base.cc:1034] running on GCE node
I20260923 19:40:31.331664 31893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:31.332633 31893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:31.333902 31893 hybrid_clock.cc:648] HybridClock initialized: now 1790192431333843 us; error 44 us; skew 500 ppm
I20260923 19:40:31.334331 31893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:31.336675 31893 webserver.cc:460] Webserver started at http://127.12.159.194:36317/ using document root <none> and password file <none>
I20260923 19:40:31.337426 31893 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:31.337553 31893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:31.337986 31893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:31.340916 31893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "fbded9113c764eca8cb3744eaa85b8e2"
format_stamp: "Formatted at 2026-09-23 19:40:31 on dist-test-slave-lzv7"
server_key: "04d45bdc0865b00367d16fbb102c921b"
server_key_iv: "a32d5896a265fb86241197e45598d3b1"
server_key_version: "encryptionkey@0"
I20260923 19:40:31.341686 31893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "fbded9113c764eca8cb3744eaa85b8e2"
format_stamp: "Formatted at 2026-09-23 19:40:31 on dist-test-slave-lzv7"
server_key: "04d45bdc0865b00367d16fbb102c921b"
server_key_iv: "a32d5896a265fb86241197e45598d3b1"
server_key_version: "encryptionkey@0"
I20260923 19:40:31.347303 31893 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:40:31.350932 31907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:31.352422 31893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:40:31.352596 31893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "fbded9113c764eca8cb3744eaa85b8e2"
format_stamp: "Formatted at 2026-09-23 19:40:31 on dist-test-slave-lzv7"
server_key: "04d45bdc0865b00367d16fbb102c921b"
server_key_iv: "a32d5896a265fb86241197e45598d3b1"
server_key_version: "encryptionkey@0"
I20260923 19:40:31.352821 31893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:31.373412 31893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:31.374311 31893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:31.374620 31893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:31.375617 31893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:31.377236 31893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:31.377372 31893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:31.377508 31893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:31.377599 31893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:31.411975 31893 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:39747
I20260923 19:40:31.412072 32019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:39747 every 8 connection(s)
I20260923 19:40:31.413431 31893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:40:31.416935 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 31893
I20260923 19:40:31.417138 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:40:31.417578 12927 external_mini_cluster.cc:1428] Setting key 2efe71f6224f9a294dfb45913a06b831
I20260923 19:40:31.420403 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46397
--builtin_ntp_servers=127.12.159.212:45547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:40:31.426259 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.416050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:43587 (local address 127.12.159.254:46397)
0923 19:40:31.416232 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:31.416237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:31.417782 (+ 1545us) server_negotiation.cc:407] Connection header received
0923 19:40:31.419752 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:31.419757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:31.419839 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:31.419950 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:31.421105 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.421881 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.423420 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.423841 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.423971 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.425417 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:31.425422 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:31.425425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:31.425444 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:31.425482 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:31.425493 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:31.425599 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:31.425851 (+ 252us) server_negotiation.cc:299] Negotiation successful
0923 19:40:31.425950 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:40:31.427332 32022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.416541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:46397 (local address 127.12.159.194:43587)
0923 19:40:31.417609 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:31.417658 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:31.419497 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:31.420201 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:31.420209 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:31.420294 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:31.420937 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.420955 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.422032 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.422044 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.423270 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.423282 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.424079 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.424087 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.424317 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.425083 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:31.425086 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:31.425125 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:31.425213 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:31.425599 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:31.425612 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:31.425623 (+ 11us) client_negotiation.cc:769] Sending connection context
0923 19:40:31.425845 (+ 222us) client_negotiation.cc:240] Negotiation successful
0923 19:40:31.426262 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":331,"threads_started":1}
I20260923 19:40:31.429004 32020 heartbeater.cc:347] Connected to a master server at 127.12.159.254:46397
I20260923 19:40:31.429322 32020 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:31.430155 32020 heartbeater.cc:511] Master 127.12.159.254:46397 requested a full tablet report, sending...
I20260923 19:40:31.431635 31703 ts_manager.cc:194] Registered new tserver with Master: fbded9113c764eca8cb3744eaa85b8e2 (127.12.159.194:39747)
I20260923 19:40:31.432458 31703 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.194:43587
W20260923 19:40:31.751618 32023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:31.751984 32023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:31.752118 32023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:31.760986 32023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:31.761112 32023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:31.761232 32023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:40:31.770819 32023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:46397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:31.772146 32023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:31.773851 32023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:31.787533 32031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:31.787624 32029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:31.787573 32028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:31.791291 32023 server_base.cc:1034] running on GCE node
I20260923 19:40:31.791944 32023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:31.793007 32023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:31.794248 32023 hybrid_clock.cc:648] HybridClock initialized: now 1790192431794199 us; error 41 us; skew 500 ppm
I20260923 19:40:31.794608 32023 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:31.797066 32023 webserver.cc:460] Webserver started at http://127.12.159.195:39205/ using document root <none> and password file <none>
I20260923 19:40:31.797875 32023 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:31.798010 32023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:31.798349 32023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:31.801447 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "754fd821657b47da8a10cdf6a685df68"
format_stamp: "Formatted at 2026-09-23 19:40:31 on dist-test-slave-lzv7"
server_key: "d43bd6280d29702fb7565ec04c7bfcd3"
server_key_iv: "28713c1271d08cc8a8c169292ddc6a6a"
server_key_version: "encryptionkey@0"
I20260923 19:40:31.802325 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "754fd821657b47da8a10cdf6a685df68"
format_stamp: "Formatted at 2026-09-23 19:40:31 on dist-test-slave-lzv7"
server_key: "d43bd6280d29702fb7565ec04c7bfcd3"
server_key_iv: "28713c1271d08cc8a8c169292ddc6a6a"
server_key_version: "encryptionkey@0"
I20260923 19:40:31.807734 32023 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:40:31.811622 32037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:31.813107 32023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:40:31.813319 32023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "754fd821657b47da8a10cdf6a685df68"
format_stamp: "Formatted at 2026-09-23 19:40:31 on dist-test-slave-lzv7"
server_key: "d43bd6280d29702fb7565ec04c7bfcd3"
server_key_iv: "28713c1271d08cc8a8c169292ddc6a6a"
server_key_version: "encryptionkey@0"
I20260923 19:40:31.813568 32023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:31.839098 32023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:31.839964 32023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:31.840270 32023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:31.841280 32023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:31.843060 32023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:31.843192 32023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:31.843326 32023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:31.843416 32023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:31.879024 32023 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:37305
I20260923 19:40:31.879117 32149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:37305 every 8 connection(s)
I20260923 19:40:31.880451 32023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:40:31.885941 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 32023
I20260923 19:40:31.886132 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:40:31.886703 12927 external_mini_cluster.cc:1428] Setting key fe11fc0227035a059d7c74ea6651d6f9
I20260923 19:40:31.894086 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.883271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:42603 (local address 127.12.159.254:46397)
0923 19:40:31.883453 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:31.883457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:31.884867 (+ 1410us) server_negotiation.cc:407] Connection header received
0923 19:40:31.887285 (+ 2418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:31.887292 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:31.887386 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:31.887510 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:31.888932 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.890053 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.891573 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.891955 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.892056 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.893362 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:31.893366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:31.893369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:31.893386 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:31.893414 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:31.893425 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:31.893492 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:31.893699 (+ 207us) server_negotiation.cc:299] Negotiation successful
0923 19:40:31.893773 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:40:31.895092 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.883830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:46397 (local address 127.12.159.195:42603)
0923 19:40:31.884703 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:31.884738 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:31.886930 (+ 2192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:31.887784 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:31.887793 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:31.887923 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:31.888767 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.888794 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.890197 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.890202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.891448 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.891461 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.892141 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.892145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.892341 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.893062 (+ 721us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:31.893066 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:31.893114 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:31.893197 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:31.893509 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:31.893516 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:31.893522 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:40:31.893671 (+ 149us) client_negotiation.cc:240] Negotiation successful
0923 19:40:31.894032 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":264,"threads_started":1}
I20260923 19:40:31.896454 32150 heartbeater.cc:347] Connected to a master server at 127.12.159.254:46397
I20260923 19:40:31.896766 32150 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:31.897486 32150 heartbeater.cc:511] Master 127.12.159.254:46397 requested a full tablet report, sending...
I20260923 19:40:31.898914 31703 ts_manager.cc:194] Registered new tserver with Master: 754fd821657b47da8a10cdf6a685df68 (127.12.159.195:37305)
I20260923 19:40:31.899720 31703 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.195:42603
I20260923 19:40:31.901997 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:40:31.911625 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.906064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58832 (local address 127.12.159.254:46397)
0923 19:40:31.906252 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:31.906290 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:31.906655 (+ 365us) server_negotiation.cc:407] Connection header received
0923 19:40:31.906799 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:31.906803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:31.906862 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:31.906944 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:31.907454 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.908165 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.909463 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.909928 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.910021 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.910994 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:31.910998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:31.911001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:31.911018 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:31.911067 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:31.911081 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:31.911192 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:31.911345 (+ 153us) server_negotiation.cc:299] Negotiation successful
0923 19:40:31.911388 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:40:31.915388 31703 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:40:31.922320 31703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:40:31.962648 32163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.934786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48366 (local address 127.12.159.194:39747)
0923 19:40:31.953684 (+ 18898us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:31.953695 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:31.953733 (+ 38us) server_negotiation.cc:407] Connection header received
0923 19:40:31.953879 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:31.953891 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:31.954199 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:31.955299 (+ 1100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:31.955583 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.957329 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.960412 (+ 3083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.961382 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.961583 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.961870 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:31.962142 (+ 272us) server_negotiation.cc:299] Negotiation successful
0923 19:40:31.962310 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18689,"thread_start_us":18574,"threads_started":1}
I20260923 19:40:31.962738 32162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.934782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:39747 (local address 127.0.0.1:48366)
0923 19:40:31.952982 (+ 18200us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:31.953004 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:31.953133 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:31.954465 (+ 1332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:31.954473 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:31.954508 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:31.955020 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.955035 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.957486 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.957493 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.960184 (+ 2691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.960200 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.961598 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.961604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.961879 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.961952 (+ 73us) client_negotiation.cc:769] Sending connection context
0923 19:40:31.962098 (+ 146us) client_negotiation.cc:240] Negotiation successful
0923 19:40:31.962288 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18039,"mutex_wait_us":125,"thread_start_us":16298,"threads_started":1}
I20260923 19:40:31.963330 32165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.934763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:37305 (local address 127.0.0.1:56142)
0923 19:40:31.950840 (+ 16077us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:31.950896 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:31.951089 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:31.953655 (+ 2566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:31.953662 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:31.953696 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:31.954245 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.954263 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.957097 (+ 2834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.957103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.960193 (+ 3090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.960202 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.962517 (+ 2315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.962523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.962706 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.962757 (+ 51us) client_negotiation.cc:769] Sending connection context
0923 19:40:31.962827 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 19:40:31.962958 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15784,"mutex_wait_us":172,"thread_start_us":17892,"threads_started":1}
I20260923 19:40:31.964098 32164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.935217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56142 (local address 127.12.159.195:37305)
0923 19:40:31.950775 (+ 15558us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:31.950787 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:31.951040 (+ 253us) server_negotiation.cc:407] Connection header received
0923 19:40:31.951423 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:31.951431 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:31.951728 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:31.951956 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:31.954526 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.956808 (+ 2282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.960436 (+ 3628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.961987 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.962173 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.962360 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:31.963570 (+ 1210us) server_negotiation.cc:299] Negotiation successful
0923 19:40:31.963741 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15331,"thread_start_us":15593,"threads_started":1}
I20260923 19:40:31.965220 32167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.953858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45468)
0923 19:40:31.957608 (+ 3750us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:31.957624 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:31.957791 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:31.958357 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:31.958361 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:31.958385 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:31.958897 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.958913 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.960532 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.960537 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.962617 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:31.962630 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.964499 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.964506 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:31.964671 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.964710 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:40:31.964793 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 19:40:31.964916 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3564,"thread_start_us":3287,"threads_started":1}
I20260923 19:40:31.965312 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:31.953313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45468 (local address 127.12.159.193:42157)
0923 19:40:31.957101 (+ 3788us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:31.957109 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:31.957760 (+ 651us) server_negotiation.cc:407] Connection header received
0923 19:40:31.957998 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:31.958004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:31.958183 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:31.958369 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:31.959122 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.960388 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.962840 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:31.964295 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:31.964551 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:31.964766 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:31.964829 (+ 63us) server_negotiation.cc:299] Negotiation successful
0923 19:40:31.964972 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3607,"thread_start_us":3492,"threads_started":1}
I20260923 19:40:31.967185 31955 tablet_service.cc:1467] Processing CreateTablet for tablet 325b2d5a740342d796488ba88fc64b77 (DEFAULT_TABLE table=test-table [id=274fc3f8e3974387847dd8b9db8326ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:31.967875 32085 tablet_service.cc:1467] Processing CreateTablet for tablet 325b2d5a740342d796488ba88fc64b77 (DEFAULT_TABLE table=test-table [id=274fc3f8e3974387847dd8b9db8326ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:31.968407 31955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325b2d5a740342d796488ba88fc64b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:31.968691 31824 tablet_service.cc:1467] Processing CreateTablet for tablet 325b2d5a740342d796488ba88fc64b77 (DEFAULT_TABLE table=test-table [id=274fc3f8e3974387847dd8b9db8326ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:31.969290 32085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325b2d5a740342d796488ba88fc64b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:31.969961 31824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325b2d5a740342d796488ba88fc64b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:31.970598 31889 heartbeater.cc:503] Master 127.12.159.254:46397 was elected leader, sending a full tablet report...
I20260923 19:40:31.982489 32168 tablet_bootstrap.cc:492] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Bootstrap starting.
I20260923 19:40:31.985993 32168 tablet_bootstrap.cc:654] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:31.987310 32170 tablet_bootstrap.cc:492] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: Bootstrap starting.
I20260923 19:40:31.987493 32168 log.cc:824] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:31.987497 32169 tablet_bootstrap.cc:492] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Bootstrap starting.
I20260923 19:40:31.991269 32170 tablet_bootstrap.cc:654] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:31.992087 32169 tablet_bootstrap.cc:654] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:31.992516 32170 log.cc:824] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:31.993280 32169 log.cc:824] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:31.994341 32168 tablet_bootstrap.cc:492] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: No bootstrap required, opened a new log
I20260923 19:40:31.994660 32168 ts_tablet_manager.cc:1397] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.009s
I20260923 19:40:31.995386 32170 tablet_bootstrap.cc:492] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: No bootstrap required, opened a new log
I20260923 19:40:31.995647 32170 ts_tablet_manager.cc:1397] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260923 19:40:31.996261 32169 tablet_bootstrap.cc:492] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: No bootstrap required, opened a new log
I20260923 19:40:31.996506 32169 ts_tablet_manager.cc:1397] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:40:32.003522 32170 raft_consensus.cc:348] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.003952 32170 raft_consensus.cc:374] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:32.004051 32170 raft_consensus.cc:729] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de23c310c3524a1e8198a55d1a04bbf7, State: Initialized, Role: FOLLOWER
I20260923 19:40:32.004760 32170 consensus_queue.cc:260] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.005592 32168 raft_consensus.cc:348] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.006073 32168 raft_consensus.cc:374] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:32.006161 32168 raft_consensus.cc:729] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbded9113c764eca8cb3744eaa85b8e2, State: Initialized, Role: FOLLOWER
I20260923 19:40:32.006726 32170 ts_tablet_manager.cc:1428] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: Time spent starting tablet: real 0.011s user 0.009s sys 0.004s
I20260923 19:40:32.006897 32168 consensus_queue.cc:260] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.007268 32169 raft_consensus.cc:348] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.007718 32169 raft_consensus.cc:374] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:32.007824 32169 raft_consensus.cc:729] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 754fd821657b47da8a10cdf6a685df68, State: Initialized, Role: FOLLOWER
I20260923 19:40:32.008199 32020 heartbeater.cc:503] Master 127.12.159.254:46397 was elected leader, sending a full tablet report...
I20260923 19:40:32.008369 32169 consensus_queue.cc:260] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.008733 32168 ts_tablet_manager.cc:1428] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260923 19:40:32.010041 32150 heartbeater.cc:503] Master 127.12.159.254:46397 was elected leader, sending a full tablet report...
I20260923 19:40:32.011775 32169 ts_tablet_manager.cc:1428] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260923 19:40:32.132237 32151 tablet.cc:2369] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:40:32.165557 32021 tablet.cc:2369] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:40:32.197192 31890 tablet.cc:2369] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:40:32.303778 32174 raft_consensus.cc:482] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:40:32.304180 32174 raft_consensus.cc:504] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.306015 32174 leader_election.cc:288] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbded9113c764eca8cb3744eaa85b8e2 (127.12.159.194:39747), 754fd821657b47da8a10cdf6a685df68 (127.12.159.195:37305)
I20260923 19:40:32.315577 32164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.306733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:35947 (local address 127.12.159.195:37305)
0923 19:40:32.306973 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:32.306982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:32.307477 (+ 495us) server_negotiation.cc:407] Connection header received
0923 19:40:32.307752 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:32.307757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:32.307825 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:32.307912 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:32.308713 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.309873 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.313010 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.314197 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.314370 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.314441 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:32.315177 (+ 736us) server_negotiation.cc:299] Negotiation successful
0923 19:40:32.315309 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 19:40:32.315565 32163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.306363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:53637 (local address 127.12.159.194:39747)
0923 19:40:32.306583 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:32.306591 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:32.307577 (+ 986us) server_negotiation.cc:407] Connection header received
0923 19:40:32.307702 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:32.307709 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:32.307804 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:32.307912 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:32.308735 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.309878 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.313010 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.314232 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.314371 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.314441 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:32.315177 (+ 736us) server_negotiation.cc:299] Negotiation successful
0923 19:40:32.315309 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:40:32.316205 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.306432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:37305 (local address 127.12.159.193:35947)
0923 19:40:32.307360 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.307382 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:32.307547 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:32.307943 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:32.307948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:32.308040 (+ 92us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:32.308511 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:32.308525 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.310043 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.310049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:32.312776 (+ 2727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:32.312788 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.314489 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.314500 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:32.314898 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.315026 (+ 128us) client_negotiation.cc:769] Sending connection context
0923 19:40:32.315146 (+ 120us) client_negotiation.cc:240] Negotiation successful
0923 19:40:32.315373 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"mutex_wait_us":404,"thread_start_us":538,"threads_started":1}
I20260923 19:40:32.316298 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.306433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:39747 (local address 127.12.159.193:53637)
0923 19:40:32.307469 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.307484 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:32.307580 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:32.307943 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:32.307948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:32.307976 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:32.308553 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:32.308564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.310013 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.310020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:32.312773 (+ 2753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:32.312788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.314535 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.314541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:32.314898 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.315028 (+ 130us) client_negotiation.cc:769] Sending connection context
0923 19:40:32.315140 (+ 112us) client_negotiation.cc:240] Negotiation successful
0923 19:40:32.315368 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"mutex_wait_us":489,"thread_start_us":510,"threads_started":1}
I20260923 19:40:32.317561 32105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325b2d5a740342d796488ba88fc64b77" candidate_uuid: "de23c310c3524a1e8198a55d1a04bbf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "754fd821657b47da8a10cdf6a685df68" is_pre_election: true
I20260923 19:40:32.317544 31975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325b2d5a740342d796488ba88fc64b77" candidate_uuid: "de23c310c3524a1e8198a55d1a04bbf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbded9113c764eca8cb3744eaa85b8e2" is_pre_election: true
I20260923 19:40:32.318219 32105 raft_consensus.cc:2454] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de23c310c3524a1e8198a55d1a04bbf7 in term 0.
I20260923 19:40:32.318219 31975 raft_consensus.cc:2454] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de23c310c3524a1e8198a55d1a04bbf7 in term 0.
I20260923 19:40:32.318944 31777 leader_election.cc:302] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 754fd821657b47da8a10cdf6a685df68, de23c310c3524a1e8198a55d1a04bbf7; no voters:
I20260923 19:40:32.319449 32174 raft_consensus.cc:2781] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:40:32.319674 32174 raft_consensus.cc:482] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:40:32.319841 32174 raft_consensus.cc:3037] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:32.322216 32174 raft_consensus.cc:504] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.322826 32174 leader_election.cc:288] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [CANDIDATE]: Term 1 election: Requested vote from peers fbded9113c764eca8cb3744eaa85b8e2 (127.12.159.194:39747), 754fd821657b47da8a10cdf6a685df68 (127.12.159.195:37305)
I20260923 19:40:32.323342 31975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325b2d5a740342d796488ba88fc64b77" candidate_uuid: "de23c310c3524a1e8198a55d1a04bbf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbded9113c764eca8cb3744eaa85b8e2"
I20260923 19:40:32.323357 32105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325b2d5a740342d796488ba88fc64b77" candidate_uuid: "de23c310c3524a1e8198a55d1a04bbf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "754fd821657b47da8a10cdf6a685df68"
I20260923 19:40:32.323571 31975 raft_consensus.cc:3037] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:32.323559 32105 raft_consensus.cc:3037] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:32.325958 32105 raft_consensus.cc:2454] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de23c310c3524a1e8198a55d1a04bbf7 in term 1.
I20260923 19:40:32.325978 31975 raft_consensus.cc:2454] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de23c310c3524a1e8198a55d1a04bbf7 in term 1.
I20260923 19:40:32.326418 31777 leader_election.cc:302] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 754fd821657b47da8a10cdf6a685df68, de23c310c3524a1e8198a55d1a04bbf7; no voters:
I20260923 19:40:32.326740 32174 raft_consensus.cc:2781] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:32.327242 32174 raft_consensus.cc:686] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 1 LEADER]: Becoming Leader. State: Replica: de23c310c3524a1e8198a55d1a04bbf7, State: Running, Role: LEADER
I20260923 19:40:32.327767 32174 consensus_queue.cc:237] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } }
I20260923 19:40:32.332314 31702 catalog_manager.cc:5495] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to de23c310c3524a1e8198a55d1a04bbf7 (127.12.159.193). New cstate: current_term: 1 leader_uuid: "de23c310c3524a1e8198a55d1a04bbf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de23c310c3524a1e8198a55d1a04bbf7" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 42157 } health_report { overall_health: HEALTHY } } }
I20260923 19:40:32.403081 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.397211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45484 (local address 127.12.159.193:42157)
0923 19:40:32.397467 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:32.397472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:32.397491 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:40:32.397701 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:32.397705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:32.397799 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:32.398013 (+ 214us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:40:32.398394 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.399168 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.400625 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.401016 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.401119 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.401558 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:40:32.402350 (+ 792us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:40:32.402526 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:32.402711 (+ 185us) server_negotiation.cc:299] Negotiation successful
0923 19:40:32.402763 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:40:32.411582 31975 raft_consensus.cc:1261] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 1 FOLLOWER]: Refusing update from remote peer de23c310c3524a1e8198a55d1a04bbf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:32.411607 32105 raft_consensus.cc:1261] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 1 FOLLOWER]: Refusing update from remote peer de23c310c3524a1e8198a55d1a04bbf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:32.412647 32179 consensus_queue.cc:1035] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbded9113c764eca8cb3744eaa85b8e2" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 39747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:32.413012 32174 consensus_queue.cc:1035] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "754fd821657b47da8a10cdf6a685df68" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 37305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:32.428315 32182 mvcc.cc:205] Tried to move back new op lower bound from 7332628203147325440 to 7332628202818310144. Current Snapshot: MvccSnapshot[applied={T|T < 7332628203147325440}]
I20260923 19:40:32.448020 31703 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:32.448319 31703 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:32.451782 31703 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e84dfbade9cd4e29b73415390d22bea8: Sending DeleteTablet for 3 replicas of tablet 325b2d5a740342d796488ba88fc64b77
I20260923 19:40:32.452826 31955 tablet_service.cc:1514] Processing DeleteTablet for tablet 325b2d5a740342d796488ba88fc64b77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:32 UTC) from {username='slave'} at 127.0.0.1:48366
I20260923 19:40:32.453174 32085 tablet_service.cc:1514] Processing DeleteTablet for tablet 325b2d5a740342d796488ba88fc64b77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:32 UTC) from {username='slave'} at 127.0.0.1:56142
I20260923 19:40:32.453744 31824 tablet_service.cc:1514] Processing DeleteTablet for tablet 325b2d5a740342d796488ba88fc64b77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:32 UTC) from {username='slave'} at 127.0.0.1:45468
I20260923 19:40:32.454102 32193 tablet_replica.cc:330] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: stopping tablet replica
I20260923 19:40:32.454399 32192 tablet_replica.cc:330] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: stopping tablet replica
I20260923 19:40:32.454636 32193 raft_consensus.cc:2229] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:32.454790 32192 raft_consensus.cc:2229] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:32.455130 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 31762
I20260923 19:40:32.455266 32192 raft_consensus.cc:2258] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:32.455308 32193 raft_consensus.cc:2258] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:32.457996 32192 ts_tablet_manager.cc:1905] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:32.462430 32193 ts_tablet_manager.cc:1905] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:32.466081 32192 ts_tablet_manager.cc:1918] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:32.466300 32192 log.cc:1196] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/325b2d5a740342d796488ba88fc64b77
I20260923 19:40:32.466951 32192 ts_tablet_manager.cc:1939] T 325b2d5a740342d796488ba88fc64b77 P fbded9113c764eca8cb3744eaa85b8e2: Deleting consensus metadata
I20260923 19:40:32.469439 31689 catalog_manager.cc:4841] TS fbded9113c764eca8cb3744eaa85b8e2 (127.12.159.194:39747): tablet 325b2d5a740342d796488ba88fc64b77 (table test-table [id=274fc3f8e3974387847dd8b9db8326ae]) successfully deleted
I20260923 19:40:32.472810 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.458644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45492 (local address 127.12.159.193:42157)
0923 19:40:32.458817 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:32.458824 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:32.458844 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:40:32.458902 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:32.458907 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:32.459043 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:32.459152 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:32.459752 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.460988 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.463085 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.463793 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.463897 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.470898 (+ 7001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:32.470911 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:32.470930 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:32.471814 (+ 884us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:32.471882 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:32.471912 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:32.472057 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:32.472270 (+ 213us) server_negotiation.cc:299] Negotiation successful
0923 19:40:32.472400 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:40:32.473824 31884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:32.476011 32193 ts_tablet_manager.cc:1918] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:32.476210 32193 log.cc:1196] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/325b2d5a740342d796488ba88fc64b77
I20260923 19:40:32.476776 32193 ts_tablet_manager.cc:1939] T 325b2d5a740342d796488ba88fc64b77 P 754fd821657b47da8a10cdf6a685df68: Deleting consensus metadata
I20260923 19:40:32.478646 31687 catalog_manager.cc:4841] TS 754fd821657b47da8a10cdf6a685df68 (127.12.159.195:37305): tablet 325b2d5a740342d796488ba88fc64b77 (table test-table [id=274fc3f8e3974387847dd8b9db8326ae]) successfully deleted
I20260923 19:40:32.573879 32194 tablet_replica.cc:330] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7: stopping tablet replica
I20260923 19:40:32.574369 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 31762
I20260923 19:40:32.574427 32194 raft_consensus.cc:2229] T 325b2d5a740342d796488ba88fc64b77 P de23c310c3524a1e8198a55d1a04bbf7 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:40:32.593392 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 31893
W20260923 19:40:32.593623 31687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.159.193:42157 (error 108)
I20260923 19:40:32.596298 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.594968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45508)
0923 19:40:32.596005 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.596125 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":914,"thread_start_us":842,"threads_started":1}
W20260923 19:40:32.596568 31687 catalog_manager.cc:4584] TS de23c310c3524a1e8198a55d1a04bbf7 (127.12.159.193:42157): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 325b2d5a740342d796488ba88fc64b77: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
I20260923 19:40:32.601665 32163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.594329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48368 (local address 127.12.159.194:39747)
0923 19:40:32.594538 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:32.594546 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:32.594671 (+ 125us) server_negotiation.cc:407] Connection header received
0923 19:40:32.594898 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:32.594902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:32.594996 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:32.595083 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:32.595680 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.596635 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.598382 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.599049 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.599195 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.600340 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:32.600352 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:32.600371 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:32.601030 (+ 659us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:32.601079 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:32.601103 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:32.601192 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:32.601284 (+ 92us) server_negotiation.cc:299] Negotiation successful
0923 19:40:32.601379 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:40:32.602339 32015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:32.650478 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.649960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45510)
0923 19:40:32.650193 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.650302 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260923 19:40:32.651602 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.651174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45518)
0923 19:40:32.651356 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.651440 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:40:32.692284 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 31893
I20260923 19:40:32.710108 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 32023
I20260923 19:40:32.711999 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.711532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45528)
0923 19:40:32.711720 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.711817 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260923 19:40:32.712962 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.712598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45538)
0923 19:40:32.712741 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.712812 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260923 19:40:32.717209 32164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.710921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56148 (local address 127.12.159.195:37305)
0923 19:40:32.711099 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:32.711105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:32.711128 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:40:32.711285 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:32.711290 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:32.711411 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:32.711536 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:32.711940 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.712841 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.714209 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:32.714678 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:32.714819 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:32.715992 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:32.716001 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:32.716016 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:32.716583 (+ 567us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:32.716630 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:32.716649 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:32.716740 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:32.716827 (+ 87us) server_negotiation.cc:299] Negotiation successful
0923 19:40:32.716910 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:40:32.717967 32145 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:32.793749 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.793159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45544)
0923 19:40:32.793439 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.793563 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260923 19:40:32.794919 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:32.794458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:42157 (local address 127.0.0.1:45548)
0923 19:40:32.794669 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:32.794762 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:42157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260923 19:40:32.809432 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 32023
I20260923 19:40:32.827040 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 31672
I20260923 19:40:32.828222 31733 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:32.939563 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 31672
2026-09-23T19:40:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3083 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:33 dist-test-slave-lzv7 krb5kdc[32204](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:33 dist-test-slave-lzv7 krb5kdc[32204](info): set up 2 sockets
Sep 23 19:40:33 dist-test-slave-lzv7 krb5kdc[32204](info): commencing operation
krb5kdc: starting...
W20260923 19:40:34.058193 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.003s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:34 dist-test-slave-lzv7 krb5kdc[32204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:40:34.314247 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33385
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33385
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:34.658133 32217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:34.658434 32217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:34.658619 32217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:34.666074 32217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:34.666254 32217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:34.666378 32217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:34.666489 32217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:34.666579 32217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:34.676643 32217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:34.678126 32217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:34.679486 32217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:34.691735 32222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:34.691701 32223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:34.691742 32225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:34.692988 32217 server_base.cc:1034] running on GCE node
I20260923 19:40:34.693974 32217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:34.695547 32217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:34.696791 32217 hybrid_clock.cc:648] HybridClock initialized: now 1790192434696744 us; error 37 us; skew 500 ppm
I20260923 19:40:34.697186 32217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:34 dist-test-slave-lzv7 krb5kdc[32204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192434, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:34.700522 32217 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:40:34.702306 32217 webserver.cc:460] Webserver started at http://127.12.159.254:45913/ using document root <none> and password file <none>
I20260923 19:40:34.703095 32217 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:34.703253 32217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:34.703580 32217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:34.706869 32217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "9b4776adc28a42c0803f4a8db388ae6a"
format_stamp: "Formatted at 2026-09-23 19:40:34 on dist-test-slave-lzv7"
server_key: "e09d21ec1f5a298d6b5cd6ceeb6a8cb6"
server_key_iv: "e6a58ac21d083fa833f7262b95d27258"
server_key_version: "encryptionkey@0"
I20260923 19:40:34.707682 32217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "9b4776adc28a42c0803f4a8db388ae6a"
format_stamp: "Formatted at 2026-09-23 19:40:34 on dist-test-slave-lzv7"
server_key: "e09d21ec1f5a298d6b5cd6ceeb6a8cb6"
server_key_iv: "e6a58ac21d083fa833f7262b95d27258"
server_key_version: "encryptionkey@0"
I20260923 19:40:34.713168 32217 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:40:34.716859 32232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:34.718252 32217 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:40:34.718446 32217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "9b4776adc28a42c0803f4a8db388ae6a"
format_stamp: "Formatted at 2026-09-23 19:40:34 on dist-test-slave-lzv7"
server_key: "e09d21ec1f5a298d6b5cd6ceeb6a8cb6"
server_key_iv: "e6a58ac21d083fa833f7262b95d27258"
server_key_version: "encryptionkey@0"
I20260923 19:40:34.718657 32217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:34.753767 32217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:34.758265 32217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:34.758581 32217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:34.778882 32217 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:33385
I20260923 19:40:34.778925 32283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:33385 every 8 connection(s)
I20260923 19:40:34.780735 32217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:34.784770 32284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:34.789549 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 32217
I20260923 19:40:34.789737 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:34.790192 12927 external_mini_cluster.cc:1428] Setting key cab70bc6357003a74176fce4c140a69c
I20260923 19:40:34.796779 32284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a: Bootstrap starting.
I20260923 19:40:34.800660 32284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:34.801944 32284 log.cc:824] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:34.804823 32284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a: No bootstrap required, opened a new log
Sep 23 19:40:34 dist-test-slave-lzv7 krb5kdc[32204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:34.813762 32284 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4776adc28a42c0803f4a8db388ae6a" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33385 } }
I20260923 19:40:34.814339 32284 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:34.814484 32284 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4776adc28a42c0803f4a8db388ae6a, State: Initialized, Role: FOLLOWER
I20260923 19:40:34.815081 32284 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4776adc28a42c0803f4a8db388ae6a" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33385 } }
I20260923 19:40:34.815366 32284 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:34.815521 32284 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:34.815712 32284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:34.815795 32287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:34.792325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39158 (local address 127.12.159.254:33385)
0923 19:40:34.793141 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:34.793156 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:34.793201 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:40:34.795233 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:34.795263 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:34.795671 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:34.795999 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:34.797914 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:34.799273 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:34.801318 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:34.802156 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:34.802287 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:34.806897 (+ 4610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:34.806912 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:34.806929 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:34.806979 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:34.810937 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:34.811752 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:34.811760 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:34.811767 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:34.811966 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:34.812390 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:34.812396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:34.812399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:34.813059 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:34.813383 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:34.813889 (+ 506us) server_negotiation.cc:299] Negotiation successful
0923 19:40:34.814378 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":374,"threads_started":1}
I20260923 19:40:34.818732 32284 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4776adc28a42c0803f4a8db388ae6a" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33385 } }
I20260923 19:40:34.819317 32284 leader_election.cc:302] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b4776adc28a42c0803f4a8db388ae6a; no voters:
I20260923 19:40:34.819921 32284 leader_election.cc:288] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:34.820078 32289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:34.820801 32289 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [term 1 LEADER]: Becoming Leader. State: Replica: 9b4776adc28a42c0803f4a8db388ae6a, State: Running, Role: LEADER
I20260923 19:40:34.821317 32289 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4776adc28a42c0803f4a8db388ae6a" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33385 } }
I20260923 19:40:34.822242 32284 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:34.824591 32291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b4776adc28a42c0803f4a8db388ae6a. Latest consensus state: current_term: 1 leader_uuid: "9b4776adc28a42c0803f4a8db388ae6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4776adc28a42c0803f4a8db388ae6a" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33385 } } }
I20260923 19:40:34.825100 32291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:34.825315 32290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b4776adc28a42c0803f4a8db388ae6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b4776adc28a42c0803f4a8db388ae6a" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33385 } } }
I20260923 19:40:34.825721 32290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:34.827250 32298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:34.832921 32298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:34.842121 32298 catalog_manager.cc:1347] Generated new cluster ID: a2ed284ce98243d3a5894ea45c512fd7
I20260923 19:40:34.842259 32298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:34.874505 32298 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:34.876224 32298 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:34.886252 32298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a: Generated new TSK 0
I20260923 19:40:34.887094 32298 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.159.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
Entry for principal kudu/127.12.159.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab.
I20260923 19:40:34.949986 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33385
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:35.291982 32310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:35.292279 32310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:35.292438 32310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:35.300149 32310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:35.300272 32310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:35.300479 32310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:40:35.310806 32310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.193.keytab
--principal=kudu/127.12.159.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:35.312170 32310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:35.313498 32310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:35.327858 32318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:35.327812 32316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:35.328133 32315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:35.329033 32310 server_base.cc:1034] running on GCE node
I20260923 19:40:35.329658 32310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:35.330716 32310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:35.331972 32310 hybrid_clock.cc:648] HybridClock initialized: now 1790192435331928 us; error 65 us; skew 500 ppm
I20260923 19:40:35.332309 32310 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:35 dist-test-slave-lzv7 krb5kdc[32204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192435, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:35.335548 32310 init.cc:377] Logged in from keytab as kudu/127.12.159.193@KRBTEST.COM (short username kudu)
I20260923 19:40:35.336999 32310 webserver.cc:460] Webserver started at http://127.12.159.193:39897/ using document root <none> and password file <none>
I20260923 19:40:35.337698 32310 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:35.337890 32310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:35.338220 32310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:35.341130 32310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "7ec19fc45ef149cc86ff8a5b37f47608"
format_stamp: "Formatted at 2026-09-23 19:40:35 on dist-test-slave-lzv7"
server_key: "f908bfea30490e5199b10c1690e46b18"
server_key_iv: "148eb046ea94cedab861c6a5adac5318"
server_key_version: "encryptionkey@0"
I20260923 19:40:35.341997 32310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "7ec19fc45ef149cc86ff8a5b37f47608"
format_stamp: "Formatted at 2026-09-23 19:40:35 on dist-test-slave-lzv7"
server_key: "f908bfea30490e5199b10c1690e46b18"
server_key_iv: "148eb046ea94cedab861c6a5adac5318"
server_key_version: "encryptionkey@0"
I20260923 19:40:35.347242 32310 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:40:35.351317 32325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:35.352676 32310 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:40:35.352869 32310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "7ec19fc45ef149cc86ff8a5b37f47608"
format_stamp: "Formatted at 2026-09-23 19:40:35 on dist-test-slave-lzv7"
server_key: "f908bfea30490e5199b10c1690e46b18"
server_key_iv: "148eb046ea94cedab861c6a5adac5318"
server_key_version: "encryptionkey@0"
I20260923 19:40:35.353092 32310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:35.364050 32310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:35.368036 32310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:35.368338 32310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:35.369287 32310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:35.370704 32310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:35.370831 32310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:35.370987 32310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:35.371068 32310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:35.406097 32310 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:38121
I20260923 19:40:35.406137 32437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:38121 every 8 connection(s)
I20260923 19:40:35.407452 32310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:40:35.408928 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 32310
I20260923 19:40:35.409140 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:40:35.409727 12927 external_mini_cluster.cc:1428] Setting key d32295c01a63247bb39b263cbace4132
Sep 23 19:40:35 dist-test-slave-lzv7 krb5kdc[32204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192435, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.193@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:35.433152 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:35.410370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:37647 (local address 127.12.159.254:33385)
0923 19:40:35.410915 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:35.410920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:35.412016 (+ 1096us) server_negotiation.cc:407] Connection header received
0923 19:40:35.415017 (+ 3001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:35.415021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:35.415099 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:35.415213 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:35.417394 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.418291 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.420951 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.421358 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.421479 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:35.425453 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:35.425462 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:35.425470 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:35.425518 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:35.429390 (+ 3872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:35.430351 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:35.430360 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:35.430366 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:35.430540 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:35.431002 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:35.431009 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:35.431015 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:35.431444 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:35.431599 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:35.432367 (+ 768us) server_negotiation.cc:299] Negotiation successful
0923 19:40:35.432646 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":300,"threads_started":1}
I20260923 19:40:35.433794 32441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:35.411032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33385 (local address 127.12.159.193:37647)
0923 19:40:35.411852 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:35.411921 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:35.414662 (+ 2741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:35.415504 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:35.415518 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:35.416325 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:35.417181 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:35.417211 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.418453 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.418461 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:35.420711 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:35.420736 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.421637 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.421648 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:35.421966 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:35.422750 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:35.422773 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:35.425179 (+ 2406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:35.429575 (+ 4396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:35.429583 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:35.429612 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:35.430188 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:35.430671 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:35.430675 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:35.430677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:35.430872 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:35.431589 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:35.431595 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:35.431939 (+ 344us) client_negotiation.cc:769] Sending connection context
0923 19:40:35.432191 (+ 252us) client_negotiation.cc:240] Negotiation successful
0923 19:40:35.432610 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":305,"threads_started":1}
I20260923 19:40:35.435832 32438 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33385
I20260923 19:40:35.436183 32438 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:35.436913 32438 heartbeater.cc:511] Master 127.12.159.254:33385 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.159.194@KRBTEST.COM; defaulting to no policy
I20260923 19:40:35.439307 32249 ts_manager.cc:194] Registered new tserver with Master: 7ec19fc45ef149cc86ff8a5b37f47608 (127.12.159.193:38121)
I20260923 19:40:35.440830 32249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.193@KRBTEST.COM'} at 127.12.159.193:37647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
Entry for principal kudu/127.12.159.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab.
I20260923 19:40:35.475299 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33385
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:35.812239 32444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:35.812573 32444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:35.812758 32444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:35.820539 32444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:35.820708 32444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:35.820891 32444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:40:35.832244 32444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.194.keytab
--principal=kudu/127.12.159.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:35.833969 32444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:35.835506 32444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:35.850528 32452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:35.850615 32450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:35.850556 32449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:35.851828 32444 server_base.cc:1034] running on GCE node
I20260923 19:40:35.852555 32444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:35.853652 32444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:35.854923 32444 hybrid_clock.cc:648] HybridClock initialized: now 1790192435854857 us; error 61 us; skew 500 ppm
I20260923 19:40:35.855302 32444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:35 dist-test-slave-lzv7 krb5kdc[32204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192435, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:35.858809 32444 init.cc:377] Logged in from keytab as kudu/127.12.159.194@KRBTEST.COM (short username kudu)
I20260923 19:40:35.860540 32444 webserver.cc:460] Webserver started at http://127.12.159.194:39277/ using document root <none> and password file <none>
I20260923 19:40:35.861428 32444 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:35.861619 32444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:35.862040 32444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:35.865222 32444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "b977917801164788b9941ad8aa4045f5"
format_stamp: "Formatted at 2026-09-23 19:40:35 on dist-test-slave-lzv7"
server_key: "216802cad59d75d3f956483e12ac5aaf"
server_key_iv: "4b973cd53695c1db8d5f08b6014cc8b6"
server_key_version: "encryptionkey@0"
I20260923 19:40:35.866166 32444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "b977917801164788b9941ad8aa4045f5"
format_stamp: "Formatted at 2026-09-23 19:40:35 on dist-test-slave-lzv7"
server_key: "216802cad59d75d3f956483e12ac5aaf"
server_key_iv: "4b973cd53695c1db8d5f08b6014cc8b6"
server_key_version: "encryptionkey@0"
I20260923 19:40:35.872071 32444 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:40:35.875911 32459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:35.878075 32444 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260923 19:40:35.878301 32444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "b977917801164788b9941ad8aa4045f5"
format_stamp: "Formatted at 2026-09-23 19:40:35 on dist-test-slave-lzv7"
server_key: "216802cad59d75d3f956483e12ac5aaf"
server_key_iv: "4b973cd53695c1db8d5f08b6014cc8b6"
server_key_version: "encryptionkey@0"
I20260923 19:40:35.878597 32444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:35.898257 32444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:35.902907 32444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:35.903231 32444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:35.904289 32444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:35.905719 32444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:35.905853 32444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:35.906011 32444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:35.906083 32444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:35.942395 32444 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:33445
I20260923 19:40:35.942440 32571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:33445 every 8 connection(s)
I20260923 19:40:35.943670 32444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:40:35.951045 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 32444
I20260923 19:40:35.951275 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:40:35.951778 12927 external_mini_cluster.cc:1428] Setting key 0b4228e0ffb75ff9d37c621438867085
Sep 23 19:40:35 dist-test-slave-lzv7 krb5kdc[32204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192435, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.194@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:35.967500 32574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:35.946411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:40393 (local address 127.12.159.254:33385)
0923 19:40:35.946904 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:35.946909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:35.947799 (+ 890us) server_negotiation.cc:407] Connection header received
0923 19:40:35.949778 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:35.949785 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:35.949904 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:35.950043 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:35.951767 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.952673 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.954851 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.955701 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.955887 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:35.959751 (+ 3864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:35.959761 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:35.959770 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:35.959823 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:35.963852 (+ 4029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:35.964915 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:35.964919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:35.964922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:35.965056 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:35.965545 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:35.965548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:35.965550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:35.965898 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:35.966023 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:35.967036 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0923 19:40:35.967216 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":274,"threads_started":1}
I20260923 19:40:35.968966 32575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:35.946871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33385 (local address 127.12.159.194:40393)
0923 19:40:35.947629 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:35.947668 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:35.949490 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:35.950301 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:35.950310 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:35.950861 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:35.951583 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:35.951603 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.952855 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.952859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:35.954585 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:35.954600 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:35.955964 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:35.955969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:35.956174 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:35.956855 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:35.956879 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:35.959484 (+ 2605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:35.964055 (+ 4571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:35.964069 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:35.964090 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:35.964780 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:35.965168 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:35.965175 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:35.965182 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:35.965436 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:35.966031 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:35.966042 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:35.966526 (+ 484us) client_negotiation.cc:769] Sending connection context
0923 19:40:35.966849 (+ 323us) client_negotiation.cc:240] Negotiation successful
0923 19:40:35.967479 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":299,"threads_started":1}
I20260923 19:40:35.970577 32572 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33385
I20260923 19:40:35.970898 32572 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:35.971652 32572 heartbeater.cc:511] Master 127.12.159.254:33385 requested a full tablet report, sending...
I20260923 19:40:35.973135 32249 ts_manager.cc:194] Registered new tserver with Master: b977917801164788b9941ad8aa4045f5 (127.12.159.194:33445)
I20260923 19:40:35.974025 32249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.194@KRBTEST.COM'} at 127.12.159.194:40393
WARNING: no policy specified for kudu/127.12.159.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
Entry for principal kudu/127.12.159.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab.
I20260923 19:40:36.013610 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33385
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:36.350311 32578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:36.350594 32578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:36.350690 32578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:36.358054 32578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:36.358165 32578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:36.358280 32578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:40:36.368530 32578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.195.keytab
--principal=kudu/127.12.159.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:33385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:36.369794 32578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:36.371148 32578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:36.384699 32584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:36.384755 32583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:36.384778 32586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:36.385551 32578 server_base.cc:1034] running on GCE node
I20260923 19:40:36.386252 32578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:36.387218 32578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:36.388461 32578 hybrid_clock.cc:648] HybridClock initialized: now 1790192436388413 us; error 55 us; skew 500 ppm
I20260923 19:40:36.388804 32578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:36 dist-test-slave-lzv7 krb5kdc[32204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192436, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:36.391914 32578 init.cc:377] Logged in from keytab as kudu/127.12.159.195@KRBTEST.COM (short username kudu)
I20260923 19:40:36.393270 32578 webserver.cc:460] Webserver started at http://127.12.159.195:36459/ using document root <none> and password file <none>
I20260923 19:40:36.393981 32578 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:36.394085 32578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:36.394340 32578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:36.397145 32578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "a408eb4689344ee9a13a636d20e48b55"
format_stamp: "Formatted at 2026-09-23 19:40:36 on dist-test-slave-lzv7"
server_key: "5bd1ff7d72fa82ace08b480b1c14f171"
server_key_iv: "336e51b7418aba49b4d79ea3c9357619"
server_key_version: "encryptionkey@0"
I20260923 19:40:36.397928 32578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "a408eb4689344ee9a13a636d20e48b55"
format_stamp: "Formatted at 2026-09-23 19:40:36 on dist-test-slave-lzv7"
server_key: "5bd1ff7d72fa82ace08b480b1c14f171"
server_key_iv: "336e51b7418aba49b4d79ea3c9357619"
server_key_version: "encryptionkey@0"
I20260923 19:40:36.403157 32578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:40:36.407372 32593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:36.408996 32578 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:40:36.409174 32578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "a408eb4689344ee9a13a636d20e48b55"
format_stamp: "Formatted at 2026-09-23 19:40:36 on dist-test-slave-lzv7"
server_key: "5bd1ff7d72fa82ace08b480b1c14f171"
server_key_iv: "336e51b7418aba49b4d79ea3c9357619"
server_key_version: "encryptionkey@0"
I20260923 19:40:36.409399 32578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:36.434478 32578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:36.439152 32578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:36.439509 32578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:36.440537 32578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:36.441985 32578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:36.442090 32578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:36.442243 32578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:36.442317 32578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:36.443944 32438 heartbeater.cc:503] Master 127.12.159.254:33385 was elected leader, sending a full tablet report...
I20260923 19:40:36.476964 32578 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:43625
I20260923 19:40:36.476984 32705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:43625 every 8 connection(s)
I20260923 19:40:36.478397 32578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:40:36.480234 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 32578
I20260923 19:40:36.480449 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:40:36.480971 12927 external_mini_cluster.cc:1428] Setting key 71fbd55758d0a886caa16221363edb5b
Sep 23 19:40:36 dist-test-slave-lzv7 krb5kdc[32204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192436, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.195@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:40:36.499814 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.481058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:45593 (local address 127.12.159.254:33385)
0923 19:40:36.481545 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.481552 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.482781 (+ 1229us) server_negotiation.cc:407] Connection header received
0923 19:40:36.485113 (+ 2332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.485119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.485213 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.485362 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:36.486935 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.487709 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.489275 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.489942 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.490089 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.493458 (+ 3369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:36.493464 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:36.493468 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:36.493510 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:36.496782 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.497549 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.497552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.497554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.497668 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.498218 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.498222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.498224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.498476 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:36.498603 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.499361 (+ 758us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.499535 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":218,"threads_started":1}
I20260923 19:40:36.500782 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.481714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33385 (local address 127.12.159.195:45593)
0923 19:40:36.482631 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:36.482687 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:36.484832 (+ 2145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:36.485599 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:36.485607 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:36.486204 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:36.486764 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.486782 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.487863 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.487869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.489118 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.489130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.490166 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.490184 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.490454 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.491088 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:40:36.491109 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:36.493238 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:36.496958 (+ 3720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:36.496965 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:36.496978 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:36.497439 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:36.497790 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:40:36.497794 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:40:36.497796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:40:36.498117 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:40:36.498607 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:36.498613 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:36.499024 (+ 411us) client_negotiation.cc:769] Sending connection context
0923 19:40:36.499261 (+ 237us) client_negotiation.cc:240] Negotiation successful
0923 19:40:36.499654 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":327,"threads_started":1}
I20260923 19:40:36.502229 32706 heartbeater.cc:347] Connected to a master server at 127.12.159.254:33385
I20260923 19:40:36.502496 32706 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:36.503149 32706 heartbeater.cc:511] Master 127.12.159.254:33385 requested a full tablet report, sending...
I20260923 19:40:36.504624 32249 ts_manager.cc:194] Registered new tserver with Master: a408eb4689344ee9a13a636d20e48b55 (127.12.159.195:43625)
I20260923 19:40:36.505481 32249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.159.195@KRBTEST.COM'} at 127.12.159.195:45593
I20260923 19:40:36.508877 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:40:36.528151 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.513167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39164 (local address 127.12.159.254:33385)
0923 19:40:36.513398 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.513406 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.513757 (+ 351us) server_negotiation.cc:407] Connection header received
0923 19:40:36.513994 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.513998 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.514088 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.514211 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:36.515737 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.516416 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.517682 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.518140 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.518231 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.520738 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:36.520747 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:36.520753 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:36.520795 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:36.524761 (+ 3966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.525726 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.525732 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.525735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.525950 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.526496 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.526510 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.526514 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.526964 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:36.527213 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.527600 (+ 387us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.527822 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260923 19:40:36.532084 32249 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:40:36.538970 32249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:40:36.561576 32721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.550875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35404 (local address 127.12.159.195:43625)
0923 19:40:36.551593 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.551606 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.552289 (+ 683us) server_negotiation.cc:407] Connection header received
0923 19:40:36.552699 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.552709 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.552967 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.553170 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:36.554319 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.556047 (+ 1728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.558698 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.560258 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.560455 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.560640 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.561061 (+ 421us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.561249 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":603,"threads_started":1}
I20260923 19:40:36.561648 32719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.550747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:43625 (local address 127.0.0.1:35404)
0923 19:40:36.552143 (+ 1396us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:36.552184 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:36.552439 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:36.553594 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:36.553604 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:36.553651 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:36.554084 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.554101 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.556225 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.556230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.558534 (+ 2304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.558547 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.560477 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.560483 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.560746 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.560823 (+ 77us) client_negotiation.cc:769] Sending connection context
0923 19:40:36.560985 (+ 162us) client_negotiation.cc:240] Negotiation successful
0923 19:40:36.561190 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1138,"mutex_wait_us":18,"thread_start_us":1011,"threads_started":1}
I20260923 19:40:36.563943 32722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.551302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51356 (local address 127.12.159.194:33445)
0923 19:40:36.554307 (+ 3005us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.554317 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.554670 (+ 353us) server_negotiation.cc:407] Connection header received
0923 19:40:36.554887 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.554894 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.555153 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.556421 (+ 1268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:36.557009 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.558647 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.561118 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.562647 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.562835 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.563000 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.563472 (+ 472us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.563626 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2846,"thread_start_us":2707,"threads_started":1}
I20260923 19:40:36.563933 32720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.550801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:33445 (local address 127.0.0.1:51356)
0923 19:40:36.554551 (+ 3750us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:36.554564 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:36.554709 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:36.556038 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:36.556042 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:36.556070 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:36.556790 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.556804 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.558752 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.558758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.560901 (+ 2143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.560913 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.563140 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.563148 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.563280 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.563304 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 19:40:36.563410 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 19:40:36.563552 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3657,"thread_start_us":3777,"threads_started":1}
I20260923 19:40:36.565833 32723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.552376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:38121 (local address 127.0.0.1:33298)
0923 19:40:36.555819 (+ 3443us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:36.555834 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:36.555951 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:36.556685 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:36.556694 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:36.556719 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:36.557127 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.557139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.559313 (+ 2174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.559319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.561976 (+ 2657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.561990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.565030 (+ 3040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.565036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.565201 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.565232 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:40:36.565327 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 19:40:36.565450 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3324,"mutex_wait_us":55,"thread_start_us":3192,"threads_started":1}
I20260923 19:40:36.565948 32724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.552848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33298 (local address 127.12.159.193:38121)
0923 19:40:36.555422 (+ 2574us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.555429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.555940 (+ 511us) server_negotiation.cc:407] Connection header received
0923 19:40:36.556162 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.556171 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.556381 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.556645 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:36.557310 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.558851 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.562168 (+ 3317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.564544 (+ 2376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.564729 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.564892 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.565405 (+ 513us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.565592 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2405,"thread_start_us":2244,"threads_started":1}
I20260923 19:40:36.566279 32641 tablet_service.cc:1467] Processing CreateTablet for tablet 103a7fa735fd4bccb0e0ba12c17faa54 (DEFAULT_TABLE table=test-table [id=437a864d881a4e3882bf1e060bc81127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:36.567792 32641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 103a7fa735fd4bccb0e0ba12c17faa54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:36.567839 32507 tablet_service.cc:1467] Processing CreateTablet for tablet 103a7fa735fd4bccb0e0ba12c17faa54 (DEFAULT_TABLE table=test-table [id=437a864d881a4e3882bf1e060bc81127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:36.569487 32507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 103a7fa735fd4bccb0e0ba12c17faa54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:36.569798 32373 tablet_service.cc:1467] Processing CreateTablet for tablet 103a7fa735fd4bccb0e0ba12c17faa54 (DEFAULT_TABLE table=test-table [id=437a864d881a4e3882bf1e060bc81127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:36.571147 32373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 103a7fa735fd4bccb0e0ba12c17faa54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:36.579624 32725 tablet_bootstrap.cc:492] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Bootstrap starting.
I20260923 19:40:36.583521 32725 tablet_bootstrap.cc:654] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:36.584466 32726 tablet_bootstrap.cc:492] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Bootstrap starting.
I20260923 19:40:36.584904 32725 log.cc:824] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:36.586339 32728 tablet_bootstrap.cc:492] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Bootstrap starting.
I20260923 19:40:36.587951 32725 tablet_bootstrap.cc:492] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: No bootstrap required, opened a new log
I20260923 19:40:36.588251 32725 ts_tablet_manager.cc:1397] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:40:36.588317 32726 tablet_bootstrap.cc:654] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:36.589498 32726 log.cc:824] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:36.589923 32728 tablet_bootstrap.cc:654] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:36.591941 32728 log.cc:824] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:36.594823 32728 tablet_bootstrap.cc:492] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: No bootstrap required, opened a new log
I20260923 19:40:36.595103 32728 ts_tablet_manager.cc:1397] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260923 19:40:36.595270 32726 tablet_bootstrap.cc:492] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: No bootstrap required, opened a new log
I20260923 19:40:36.595539 32726 ts_tablet_manager.cc:1397] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260923 19:40:36.597909 32725 raft_consensus.cc:348] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.598393 32725 raft_consensus.cc:374] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:36.598538 32725 raft_consensus.cc:729] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a408eb4689344ee9a13a636d20e48b55, State: Initialized, Role: FOLLOWER
I20260923 19:40:36.599203 32725 consensus_queue.cc:260] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.600339 32706 heartbeater.cc:503] Master 127.12.159.254:33385 was elected leader, sending a full tablet report...
I20260923 19:40:36.601006 32725 ts_tablet_manager.cc:1428] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260923 19:40:36.603571 32728 raft_consensus.cc:348] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.603916 32728 raft_consensus.cc:374] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:36.604044 32728 raft_consensus.cc:729] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ec19fc45ef149cc86ff8a5b37f47608, State: Initialized, Role: FOLLOWER
I20260923 19:40:36.604673 32728 consensus_queue.cc:260] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.606057 32726 raft_consensus.cc:348] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.606472 32728 ts_tablet_manager.cc:1428] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260923 19:40:36.606547 32726 raft_consensus.cc:374] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:36.606702 32726 raft_consensus.cc:729] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b977917801164788b9941ad8aa4045f5, State: Initialized, Role: FOLLOWER
I20260923 19:40:36.607303 32726 consensus_queue.cc:260] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.608343 32572 heartbeater.cc:503] Master 127.12.159.254:33385 was elected leader, sending a full tablet report...
I20260923 19:40:36.609004 32726 ts_tablet_manager.cc:1428] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260923 19:40:36.609402 32731 raft_consensus.cc:482] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:40:36.609704 32731 raft_consensus.cc:504] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.611513 32731 leader_election.cc:288] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b977917801164788b9941ad8aa4045f5 (127.12.159.194:33445), 7ec19fc45ef149cc86ff8a5b37f47608 (127.12.159.193:38121)
I20260923 19:40:36.618616 32722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.612758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:39295 (local address 127.12.159.194:33445)
0923 19:40:36.613097 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.613102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.613117 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:40:36.613167 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.613172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.613230 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.613312 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:36.613930 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.614822 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.616796 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.617648 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.617759 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.617862 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.618237 (+ 375us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.618374 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260923 19:40:36.618613 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.611791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:33445 (local address 127.12.159.195:39295)
0923 19:40:36.611990 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:36.612011 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:36.612127 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:36.613471 (+ 1344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:36.613476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:36.613545 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:36.613746 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.613753 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.614939 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.614944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.616648 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.616661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.617800 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.617847 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.618062 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.618102 (+ 40us) client_negotiation.cc:769] Sending connection context
0923 19:40:36.618204 (+ 102us) client_negotiation.cc:240] Negotiation successful
0923 19:40:36.618299 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":48}
I20260923 19:40:36.618780 32724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.612855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:34437 (local address 127.12.159.193:38121)
0923 19:40:36.613046 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.613051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.613070 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:40:36.613134 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.613140 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.613207 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.613300 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:36.613926 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.614796 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.617034 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.617911 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.618069 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.618135 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.618410 (+ 275us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.618547 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:40:36.618955 32734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.612366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:38121 (local address 127.12.159.195:34437)
0923 19:40:36.612849 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:36.612883 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:36.612987 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:36.613323 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:36.613326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:36.613394 (+ 68us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:36.613743 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.613753 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.615133 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.615138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.616889 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:36.616904 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.618087 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.618091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:36.618252 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.618283 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:40:36.618373 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 19:40:36.618496 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":26,"thread_start_us":2549,"threads_started":1}
I20260923 19:40:36.619740 32527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103a7fa735fd4bccb0e0ba12c17faa54" candidate_uuid: "a408eb4689344ee9a13a636d20e48b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b977917801164788b9941ad8aa4045f5" is_pre_election: true
I20260923 19:40:36.619738 32393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103a7fa735fd4bccb0e0ba12c17faa54" candidate_uuid: "a408eb4689344ee9a13a636d20e48b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" is_pre_election: true
I20260923 19:40:36.620180 32527 raft_consensus.cc:2454] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a408eb4689344ee9a13a636d20e48b55 in term 0.
I20260923 19:40:36.620201 32393 raft_consensus.cc:2454] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a408eb4689344ee9a13a636d20e48b55 in term 0.
I20260923 19:40:36.620790 32596 leader_election.cc:302] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ec19fc45ef149cc86ff8a5b37f47608, a408eb4689344ee9a13a636d20e48b55; no voters:
I20260923 19:40:36.621177 32731 raft_consensus.cc:2781] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:40:36.621310 32731 raft_consensus.cc:482] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:40:36.621443 32731 raft_consensus.cc:3037] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:36.623804 32731 raft_consensus.cc:504] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.624434 32731 leader_election.cc:288] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [CANDIDATE]: Term 1 election: Requested vote from peers b977917801164788b9941ad8aa4045f5 (127.12.159.194:33445), 7ec19fc45ef149cc86ff8a5b37f47608 (127.12.159.193:38121)
I20260923 19:40:36.624768 32527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103a7fa735fd4bccb0e0ba12c17faa54" candidate_uuid: "a408eb4689344ee9a13a636d20e48b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b977917801164788b9941ad8aa4045f5"
I20260923 19:40:36.624954 32527 raft_consensus.cc:3037] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:36.624890 32393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103a7fa735fd4bccb0e0ba12c17faa54" candidate_uuid: "a408eb4689344ee9a13a636d20e48b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ec19fc45ef149cc86ff8a5b37f47608"
I20260923 19:40:36.625123 32393 raft_consensus.cc:3037] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:36.627279 32527 raft_consensus.cc:2454] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a408eb4689344ee9a13a636d20e48b55 in term 1.
I20260923 19:40:36.627512 32393 raft_consensus.cc:2454] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a408eb4689344ee9a13a636d20e48b55 in term 1.
I20260923 19:40:36.627722 32594 leader_election.cc:302] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a408eb4689344ee9a13a636d20e48b55, b977917801164788b9941ad8aa4045f5; no voters:
I20260923 19:40:36.628036 32731 raft_consensus.cc:2781] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:36.628432 32731 raft_consensus.cc:686] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 1 LEADER]: Becoming Leader. State: Replica: a408eb4689344ee9a13a636d20e48b55, State: Running, Role: LEADER
I20260923 19:40:36.628954 32731 consensus_queue.cc:237] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } }
I20260923 19:40:36.633651 32249 catalog_manager.cc:5495] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to a408eb4689344ee9a13a636d20e48b55 (127.12.159.195). New cstate: current_term: 1 leader_uuid: "a408eb4689344ee9a13a636d20e48b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a408eb4689344ee9a13a636d20e48b55" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 43625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 } health_report { overall_health: UNKNOWN } } }
W20260923 19:40:36.659967 32439 tablet.cc:2369] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:40:36.662452 32721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.657101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.12.159.195:43625)
0923 19:40:36.657276 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.657281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.657314 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:40:36.657508 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.657511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.657606 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.657736 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:40:36.658103 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.658819 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.660422 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.660823 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.660944 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.661399 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:40:36.661977 (+ 578us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:40:36.662091 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.662173 (+ 82us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.662240 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:40:36.670317 32393 raft_consensus.cc:1261] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 1 FOLLOWER]: Refusing update from remote peer a408eb4689344ee9a13a636d20e48b55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:36.670365 32527 raft_consensus.cc:1261] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 1 FOLLOWER]: Refusing update from remote peer a408eb4689344ee9a13a636d20e48b55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:36.671334 32731 consensus_queue.cc:1035] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ec19fc45ef149cc86ff8a5b37f47608" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 38121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:36.671615 32735 consensus_queue.cc:1035] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b977917801164788b9941ad8aa4045f5" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 33445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:36.684470 32738 mvcc.cc:205] Tried to move back new op lower bound from 7332628220591808512 to 7332628220435959808. Current Snapshot: MvccSnapshot[applied={T|T < 7332628220591808512}]
I20260923 19:40:36.700744 32248 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:36.701109 32248 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:36.705000 32248 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9b4776adc28a42c0803f4a8db388ae6a: Sending DeleteTablet for 3 replicas of tablet 103a7fa735fd4bccb0e0ba12c17faa54
I20260923 19:40:36.706197 32641 tablet_service.cc:1514] Processing DeleteTablet for tablet 103a7fa735fd4bccb0e0ba12c17faa54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:35404
I20260923 19:40:36.706337 32507 tablet_service.cc:1514] Processing DeleteTablet for tablet 103a7fa735fd4bccb0e0ba12c17faa54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:51356
I20260923 19:40:36.706682 32373 tablet_service.cc:1514] Processing DeleteTablet for tablet 103a7fa735fd4bccb0e0ba12c17faa54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:36 UTC) from {username='kudu', principal='kudu/127.12.159.254@KRBTEST.COM'} at 127.0.0.1:33298
I20260923 19:40:36.708738 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 32310
I20260923 19:40:36.725759 32748 tablet_replica.cc:330] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: stopping tablet replica
I20260923 19:40:36.726527 32749 tablet_replica.cc:330] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: stopping tablet replica
I20260923 19:40:36.726814 32750 tablet_replica.cc:330] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: stopping tablet replica
I20260923 19:40:36.727073 32748 raft_consensus.cc:2229] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:40:36.727108 32749 raft_consensus.cc:2229] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:36.727240 32750 raft_consensus.cc:2229] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:36.727690 32749 raft_consensus.cc:2258] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:36.727730 32750 raft_consensus.cc:2258] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:36.727890 32748 raft_consensus.cc:2258] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:36.730505 32748 ts_tablet_manager.cc:1905] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:36.730623 32749 ts_tablet_manager.cc:1905] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:36.731798 32750 ts_tablet_manager.cc:1905] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:40:36 dist-test-slave-lzv7 krb5kdc[32204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.193@KRBTEST.COM
I20260923 19:40:36.737658 32749 ts_tablet_manager.cc:1918] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:36.737950 32749 log.cc:1196] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/103a7fa735fd4bccb0e0ba12c17faa54
I20260923 19:40:36.738580 32749 ts_tablet_manager.cc:1939] T 103a7fa735fd4bccb0e0ba12c17faa54 P b977917801164788b9941ad8aa4045f5: Deleting consensus metadata
I20260923 19:40:36.740573 32233 catalog_manager.cc:4841] TS b977917801164788b9941ad8aa4045f5 (127.12.159.194:33445): tablet 103a7fa735fd4bccb0e0ba12c17faa54 (table test-table [id=437a864d881a4e3882bf1e060bc81127]) successfully deleted
I20260923 19:40:36.743400 32748 ts_tablet_manager.cc:1918] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:36.743636 32724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.710099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33310 (local address 127.12.159.193:38121)
0923 19:40:36.710281 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.710288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.714779 (+ 4491us) server_negotiation.cc:407] Connection header received
0923 19:40:36.715811 (+ 1032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.715820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.715928 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.716032 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:36.720410 (+ 4378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.722137 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.729082 (+ 6945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.729716 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.729897 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.735626 (+ 5729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:36.735640 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:36.735664 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:36.735722 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:36.739775 (+ 4053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.740747 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.740758 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.740761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.740922 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.741423 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.741431 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.741434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.742002 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:36.742327 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.742945 (+ 618us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.743222 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:40:36.743672 32748 log.cc:1196] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/103a7fa735fd4bccb0e0ba12c17faa54
I20260923 19:40:36.744239 32748 ts_tablet_manager.cc:1939] T 103a7fa735fd4bccb0e0ba12c17faa54 P a408eb4689344ee9a13a636d20e48b55: Deleting consensus metadata
I20260923 19:40:36.744580 32750 ts_tablet_manager.cc:1918] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:36.744776 32750 log.cc:1196] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/103a7fa735fd4bccb0e0ba12c17faa54
I20260923 19:40:36.745430 32750 ts_tablet_manager.cc:1939] T 103a7fa735fd4bccb0e0ba12c17faa54 P 7ec19fc45ef149cc86ff8a5b37f47608: Deleting consensus metadata
I20260923 19:40:36.745512 32433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:36.746299 32236 catalog_manager.cc:4841] TS a408eb4689344ee9a13a636d20e48b55 (127.12.159.195:43625): tablet 103a7fa735fd4bccb0e0ba12c17faa54 (table test-table [id=437a864d881a4e3882bf1e060bc81127]) successfully deleted
I20260923 19:40:36.839454 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 32310
I20260923 19:40:36.839699 32235 catalog_manager.cc:4841] TS 7ec19fc45ef149cc86ff8a5b37f47608 (127.12.159.193:38121): tablet 103a7fa735fd4bccb0e0ba12c17faa54 (table test-table [id=437a864d881a4e3882bf1e060bc81127]) successfully deleted
I20260923 19:40:36.857923 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 32444
Sep 23 19:40:36 dist-test-slave-lzv7 krb5kdc[32204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.194@KRBTEST.COM
I20260923 19:40:36.874408 32722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.858888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51362 (local address 127.12.159.194:33445)
0923 19:40:36.859095 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.859103 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.859125 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:40:36.859191 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.859196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.859300 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.859430 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:36.860730 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.861506 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.862900 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.863421 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.863555 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.868192 (+ 4637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:36.868208 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:36.868225 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:36.868268 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:36.871366 (+ 3098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.872108 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.872116 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.872118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.872246 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.872631 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.872637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.872640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.873036 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:36.873337 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.873651 (+ 314us) server_negotiation.cc:299] Negotiation successful
0923 19:40:36.873957 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:40:36.875255 32567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:36.965369 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 32444
I20260923 19:40:36.983443 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 32578
Sep 23 19:40:36 dist-test-slave-lzv7 krb5kdc[32204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.195@KRBTEST.COM
I20260923 19:40:37.000460 32721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:36.984352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.12.159.195:43625)
0923 19:40:36.984542 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:36.984550 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:36.984638 (+ 88us) server_negotiation.cc:407] Connection header received
0923 19:40:36.984853 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:36.984859 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:36.984948 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:36.985069 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:36.986519 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.987382 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.988838 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:36.989321 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:36.989460 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:36.994304 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:36.994316 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:36.994331 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:36.994369 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:36.997313 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.998188 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.998198 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.998201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.998371 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:36.998815 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:36.998820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:36.998823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:36.999178 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:36.999531 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:36.999842 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 19:40:37.000080 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:40:37.001164 32701 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:37.123963 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 32578
I20260923 19:40:37.143196 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 32217
I20260923 19:40:37.144315 32279 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:37.256986 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 32217
2026-09-23T19:40:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4320 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-23T19:40:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:37Z Disabled control of system clock
I20260923 19:40:37.337628 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45865
--webserver_interface=127.12.159.254
--webserver_port=0
--builtin_ntp_servers=127.12.159.212:44351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:40:37.691931 32759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:37.692248 32759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:37.692386 32759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:37.700256 32759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:37.700384 32759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:37.700459 32759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:37.700551 32759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:37.700632 32759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:37.710428 32759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45865
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:37.711802 32759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:37.713717 32759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:37.726089 32765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:37.726387 32764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:37.726910 32767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:37.727408 32759 server_base.cc:1034] running on GCE node
I20260923 19:40:37.728262 32759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:37.729760 32759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:37.731035 32759 hybrid_clock.cc:648] HybridClock initialized: now 1790192437730957 us; error 43 us; skew 500 ppm
I20260923 19:40:37.731443 32759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:37.740232 32759 webserver.cc:460] Webserver started at http://127.12.159.254:44799/ using document root <none> and password file <none>
I20260923 19:40:37.741044 32759 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:37.741202 32759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:37.741611 32759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:37.744804 32759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201"
format_stamp: "Formatted at 2026-09-23 19:40:37 on dist-test-slave-lzv7"
server_key: "c209536093395e416090cfcbe8c8fc95"
server_key_iv: "c5a0d49f6fcc32a11e16fd7b38f52075"
server_key_version: "encryptionkey@0"
I20260923 19:40:37.745715 32759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201"
format_stamp: "Formatted at 2026-09-23 19:40:37 on dist-test-slave-lzv7"
server_key: "c209536093395e416090cfcbe8c8fc95"
server_key_iv: "c5a0d49f6fcc32a11e16fd7b38f52075"
server_key_version: "encryptionkey@0"
I20260923 19:40:37.751223 32759 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:40:37.755028 305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:37.756419 32759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:40:37.756621 32759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201"
format_stamp: "Formatted at 2026-09-23 19:40:37 on dist-test-slave-lzv7"
server_key: "c209536093395e416090cfcbe8c8fc95"
server_key_iv: "c5a0d49f6fcc32a11e16fd7b38f52075"
server_key_version: "encryptionkey@0"
I20260923 19:40:37.756855 32759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:37.773377 32759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:37.774297 32759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:37.774595 32759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:37.794905 32759 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45865
I20260923 19:40:37.794958 356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45865 every 8 connection(s)
I20260923 19:40:37.796381 32759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:37.800354 357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:37.802805 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 32759
I20260923 19:40:37.802989 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:37.803572 12927 external_mini_cluster.cc:1428] Setting key e823794ab913746b4abae5e1c2e2d6bf
I20260923 19:40:37.812829 357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201: Bootstrap starting.
I20260923 19:40:37.816111 357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:37.817296 357 log.cc:824] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:37.818255 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:37.805755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42388 (local address 127.12.159.254:45865)
0923 19:40:37.806842 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:37.806853 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:37.806897 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:40:37.808871 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:37.808896 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:37.809410 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:37.810145 (+ 735us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:37.810798 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:37.812042 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:37.813495 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:37.814260 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:37.814462 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:37.815638 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:37.815645 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:37.815659 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:37.816194 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:37.816329 (+ 135us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:37.816357 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:37.816499 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:37.816709 (+ 210us) server_negotiation.cc:299] Negotiation successful
0923 19:40:37.817014 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":347,"threads_started":1}
I20260923 19:40:37.820524 357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201: No bootstrap required, opened a new log
I20260923 19:40:37.828514 357 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45865 } }
I20260923 19:40:37.828967 357 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:37.829093 357 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cbea6d6f5c46ebb7acd7f0fdb77201, State: Initialized, Role: FOLLOWER
I20260923 19:40:37.829769 357 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45865 } }
I20260923 19:40:37.830106 357 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:37.830257 357 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:37.830441 357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:37.832867 357 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45865 } }
I20260923 19:40:37.833328 357 leader_election.cc:302] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3cbea6d6f5c46ebb7acd7f0fdb77201; no voters:
I20260923 19:40:37.833982 357 leader_election.cc:288] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:37.834151 362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:37.834867 362 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [term 1 LEADER]: Becoming Leader. State: Replica: d3cbea6d6f5c46ebb7acd7f0fdb77201, State: Running, Role: LEADER
I20260923 19:40:37.835410 362 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45865 } }
I20260923 19:40:37.836313 357 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:37.839816 364 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3cbea6d6f5c46ebb7acd7f0fdb77201. Latest consensus state: current_term: 1 leader_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45865 } } }
I20260923 19:40:37.840328 364 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:37.840796 363 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3cbea6d6f5c46ebb7acd7f0fdb77201" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45865 } } }
I20260923 19:40:37.841097 363 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:37.842584 370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:37.847853 370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:37.857265 370 catalog_manager.cc:1347] Generated new cluster ID: 567d0a35ff414afdb02a466b548e99fd
I20260923 19:40:37.857409 370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:37.872505 370 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:37.874384 370 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:37.889086 370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201: Generated new TSK 0
I20260923 19:40:37.890225 370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:37.907927 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.193:0
--local_ip_for_outbound_sockets=127.12.159.193
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45865
--builtin_ntp_servers=127.12.159.212:44351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:40:38.245975 381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:38.246328 381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:38.246483 381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:38.253844 381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:38.253993 381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:38.254212 381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.193
I20260923 19:40:38.263832 381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.159.193
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.193
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:38.265103 381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:38.267040 381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:38.280665 386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:38.280705 389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:38.280630 387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:38.281503 381 server_base.cc:1034] running on GCE node
I20260923 19:40:38.282200 381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:38.283246 381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:38.284462 381 hybrid_clock.cc:648] HybridClock initialized: now 1790192438284419 us; error 40 us; skew 500 ppm
I20260923 19:40:38.284817 381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:38.287264 381 webserver.cc:460] Webserver started at http://127.12.159.193:45033/ using document root <none> and password file <none>
I20260923 19:40:38.288003 381 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:38.288126 381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:38.288465 381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:38.291589 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data/instance:
uuid: "292c535d422e42ecaf37fa72a177427a"
format_stamp: "Formatted at 2026-09-23 19:40:38 on dist-test-slave-lzv7"
server_key: "10abf9adbe49baf2d4cfae73282175e7"
server_key_iv: "81440849bfa65b1c31fd0bbc70c4b56a"
server_key_version: "encryptionkey@0"
I20260923 19:40:38.292439 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance:
uuid: "292c535d422e42ecaf37fa72a177427a"
format_stamp: "Formatted at 2026-09-23 19:40:38 on dist-test-slave-lzv7"
server_key: "10abf9adbe49baf2d4cfae73282175e7"
server_key_iv: "81440849bfa65b1c31fd0bbc70c4b56a"
server_key_version: "encryptionkey@0"
I20260923 19:40:38.297776 381 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:40:38.301482 395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:38.302989 381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:40:38.303169 381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal
uuid: "292c535d422e42ecaf37fa72a177427a"
format_stamp: "Formatted at 2026-09-23 19:40:38 on dist-test-slave-lzv7"
server_key: "10abf9adbe49baf2d4cfae73282175e7"
server_key_iv: "81440849bfa65b1c31fd0bbc70c4b56a"
server_key_version: "encryptionkey@0"
I20260923 19:40:38.303393 381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:38.320957 381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:38.321971 381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:38.322280 381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:38.323287 381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:38.324769 381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:38.324903 381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:38.325040 381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:38.325129 381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:38.358841 381 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.193:35629
I20260923 19:40:38.358891 507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.193:35629 every 8 connection(s)
I20260923 19:40:38.360219 381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/data/info.pb
I20260923 19:40:38.363375 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 381
I20260923 19:40:38.363564 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal/instance
I20260923 19:40:38.364151 12927 external_mini_cluster.cc:1428] Setting key 3a81d387946390d8fee58459020b5fcd
I20260923 19:40:38.367245 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.194:0
--local_ip_for_outbound_sockets=127.12.159.194
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45865
--builtin_ntp_servers=127.12.159.212:44351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:40:38.374157 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:38.362972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:42671 (local address 127.12.159.254:45865)
0923 19:40:38.363490 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:38.363496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:38.365265 (+ 1769us) server_negotiation.cc:407] Connection header received
0923 19:40:38.367471 (+ 2206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:38.367479 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:38.367567 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:38.367692 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:38.368846 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.369567 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.371212 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.371634 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.371772 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:38.373228 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:38.373234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:38.373239 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:38.373268 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:38.373308 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:38.373320 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:38.373417 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:38.373664 (+ 247us) server_negotiation.cc:299] Negotiation successful
0923 19:40:38.373768 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":229,"threads_started":1}
I20260923 19:40:38.375196 511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:38.363765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45865 (local address 127.12.159.193:42671)
0923 19:40:38.364852 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:38.364910 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:38.367081 (+ 2171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:38.367960 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:38.367969 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:38.368073 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:38.368673 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:38.368690 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.369719 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.369730 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:38.371058 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:38.371071 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.371868 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.371876 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:38.372129 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:38.372892 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:38.372895 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:38.372937 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:38.373026 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:38.373416 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:38.373430 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:38.373440 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 19:40:38.373654 (+ 214us) client_negotiation.cc:240] Negotiation successful
0923 19:40:38.374109 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":341,"threads_started":1}
I20260923 19:40:38.376801 508 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45865
I20260923 19:40:38.377134 508 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:38.378100 508 heartbeater.cc:511] Master 127.12.159.254:45865 requested a full tablet report, sending...
I20260923 19:40:38.380434 322 ts_manager.cc:194] Registered new tserver with Master: 292c535d422e42ecaf37fa72a177427a (127.12.159.193:35629)
I20260923 19:40:38.382719 322 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.193:42671
W20260923 19:40:38.704169 512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:38.704471 512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:38.704566 512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:38.712148 512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:38.712255 512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:38.712368 512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.194
I20260923 19:40:38.721642 512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.159.194
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.194
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:38.723135 512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:38.724923 512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:38.738976 517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:38.739037 520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:38.739015 518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:38.739598 512 server_base.cc:1034] running on GCE node
I20260923 19:40:38.740355 512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:38.741475 512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:38.742720 512 hybrid_clock.cc:648] HybridClock initialized: now 1790192438742660 us; error 72 us; skew 500 ppm
I20260923 19:40:38.743100 512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:38.745576 512 webserver.cc:460] Webserver started at http://127.12.159.194:33017/ using document root <none> and password file <none>
I20260923 19:40:38.746367 512 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:38.746498 512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:38.746855 512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:38.749866 512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data/instance:
uuid: "944b41491cd1412391d101483a889d7e"
format_stamp: "Formatted at 2026-09-23 19:40:38 on dist-test-slave-lzv7"
server_key: "b498d4a42ab6640974b8a26d10285543"
server_key_iv: "823c0c7b81a90d8b7466151fd739b120"
server_key_version: "encryptionkey@0"
I20260923 19:40:38.750674 512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance:
uuid: "944b41491cd1412391d101483a889d7e"
format_stamp: "Formatted at 2026-09-23 19:40:38 on dist-test-slave-lzv7"
server_key: "b498d4a42ab6640974b8a26d10285543"
server_key_iv: "823c0c7b81a90d8b7466151fd739b120"
server_key_version: "encryptionkey@0"
I20260923 19:40:38.755956 512 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:40:38.759805 526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:38.761279 512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:40:38.761467 512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal
uuid: "944b41491cd1412391d101483a889d7e"
format_stamp: "Formatted at 2026-09-23 19:40:38 on dist-test-slave-lzv7"
server_key: "b498d4a42ab6640974b8a26d10285543"
server_key_iv: "823c0c7b81a90d8b7466151fd739b120"
server_key_version: "encryptionkey@0"
I20260923 19:40:38.761714 512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:38.797969 512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:38.798960 512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:38.799309 512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:38.800457 512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:38.802309 512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:38.802423 512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:38.802518 512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:38.802587 512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:38.842984 512 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.194:38597
I20260923 19:40:38.843070 638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.194:38597 every 8 connection(s)
I20260923 19:40:38.844352 512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/data/info.pb
I20260923 19:40:38.845860 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 512
I20260923 19:40:38.846060 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal/instance
I20260923 19:40:38.846490 12927 external_mini_cluster.cc:1428] Setting key 9eb2fe8e009c4e235e9288473a027f69
I20260923 19:40:38.849996 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.159.195:0
--local_ip_for_outbound_sockets=127.12.159.195
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45865
--builtin_ntp_servers=127.12.159.212:44351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:40:38.861172 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:38.847509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:59019 (local address 127.12.159.254:45865)
0923 19:40:38.847728 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:38.847733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:38.849429 (+ 1696us) server_negotiation.cc:407] Connection header received
0923 19:40:38.852351 (+ 2922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:38.852355 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:38.852422 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:38.852514 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:38.854096 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.854845 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.857566 (+ 2721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.858130 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.858236 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:38.860288 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:38.860292 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:38.860295 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:38.860316 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:38.860349 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:38.860361 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:38.860466 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:38.860704 (+ 238us) server_negotiation.cc:299] Negotiation successful
0923 19:40:38.860810 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:40:38.862470 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:38.848113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45865 (local address 127.12.159.194:59019)
0923 19:40:38.849251 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:38.849301 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:38.852020 (+ 2719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:38.852803 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:38.852816 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:38.852946 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:38.853885 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:38.853914 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.855096 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.855104 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:38.857401 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:38.857420 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:38.858371 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:38.858389 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:38.858764 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:38.859895 (+ 1131us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:38.859898 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:38.859939 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:38.860066 (+ 127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:38.860466 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:38.860479 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:38.860490 (+ 11us) client_negotiation.cc:769] Sending connection context
0923 19:40:38.860694 (+ 204us) client_negotiation.cc:240] Negotiation successful
0923 19:40:38.861197 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":347,"threads_started":1}
I20260923 19:40:38.864099 639 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45865
I20260923 19:40:38.864430 639 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:38.865319 639 heartbeater.cc:511] Master 127.12.159.254:45865 requested a full tablet report, sending...
I20260923 19:40:38.867019 322 ts_manager.cc:194] Registered new tserver with Master: 944b41491cd1412391d101483a889d7e (127.12.159.194:38597)
I20260923 19:40:38.868338 322 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.194:59019
W20260923 19:40:39.185683 642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:39.186014 642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:39.186117 642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:39.193526 642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:39.193625 642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:39.193732 642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.159.195
I20260923 19:40:39.203037 642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:44351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.159.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.159.195
--webserver_port=0
--tserver_master_addrs=127.12.159.254:45865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.159.195
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:39.204275 642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:39.205951 642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:39.220242 647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:39.220358 648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:39.220389 650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:39.221387 642 server_base.cc:1034] running on GCE node
I20260923 19:40:39.222241 642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:39.223266 642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:39.224527 642 hybrid_clock.cc:648] HybridClock initialized: now 1790192439224468 us; error 73 us; skew 500 ppm
I20260923 19:40:39.225000 642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:40:39.227417 642 webserver.cc:460] Webserver started at http://127.12.159.195:44209/ using document root <none> and password file <none>
I20260923 19:40:39.228210 642 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:39.228348 642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:39.228664 642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:39.231680 642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data/instance:
uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd"
format_stamp: "Formatted at 2026-09-23 19:40:39 on dist-test-slave-lzv7"
server_key: "d02031c5fb151e8f78a1d3f982d273a3"
server_key_iv: "d37dcb0dcc0ea3f97d639faf6c9bd9b9"
server_key_version: "encryptionkey@0"
I20260923 19:40:39.232508 642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance:
uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd"
format_stamp: "Formatted at 2026-09-23 19:40:39 on dist-test-slave-lzv7"
server_key: "d02031c5fb151e8f78a1d3f982d273a3"
server_key_iv: "d37dcb0dcc0ea3f97d639faf6c9bd9b9"
server_key_version: "encryptionkey@0"
I20260923 19:40:39.238191 642 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:40:39.242389 656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:39.244033 642 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:40:39.244251 642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal
uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd"
format_stamp: "Formatted at 2026-09-23 19:40:39 on dist-test-slave-lzv7"
server_key: "d02031c5fb151e8f78a1d3f982d273a3"
server_key_iv: "d37dcb0dcc0ea3f97d639faf6c9bd9b9"
server_key_version: "encryptionkey@0"
I20260923 19:40:39.244511 642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:39.262549 642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:39.263499 642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:39.263844 642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:39.264999 642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:40:39.266839 642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:40:39.266986 642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:39.267143 642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:40:39.267243 642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:39.303777 642 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.195:45013
I20260923 19:40:39.303813 768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.195:45013 every 8 connection(s)
I20260923 19:40:39.305349 642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/data/info.pb
I20260923 19:40:39.310235 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 642
I20260923 19:40:39.310424 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal/instance
I20260923 19:40:39.310868 12927 external_mini_cluster.cc:1428] Setting key fa0a1befd13f34a5528bf9d3a8f85989
I20260923 19:40:39.319983 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.308305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.195:34925 (local address 127.12.159.254:45865)
0923 19:40:39.308549 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.308554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.310170 (+ 1616us) server_negotiation.cc:407] Connection header received
0923 19:40:39.312725 (+ 2555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.312730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.312834 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.312961 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:39.314357 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.315183 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.316880 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.317333 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.317491 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.319086 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:39.319092 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:39.319096 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:39.319116 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:39.319150 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:39.319163 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:39.319267 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.319516 (+ 249us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.319623 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260923 19:40:39.321059 771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.308846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:45865 (local address 127.12.159.195:34925)
0923 19:40:39.309995 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.310042 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.312396 (+ 2354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.313239 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.313249 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.313349 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:40:39.314181 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.314201 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.315356 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.315362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.316722 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.316734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.317587 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.317595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.317934 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.318660 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:40:39.318663 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:40:39.318705 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:40:39.318787 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:40:39.319266 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:40:39.319278 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:40:39.319289 (+ 11us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.319489 (+ 200us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.319937 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":302,"threads_started":1}
I20260923 19:40:39.322544 769 heartbeater.cc:347] Connected to a master server at 127.12.159.254:45865
I20260923 19:40:39.322861 769 heartbeater.cc:464] Registering TS with master...
I20260923 19:40:39.323848 769 heartbeater.cc:511] Master 127.12.159.254:45865 requested a full tablet report, sending...
I20260923 19:40:39.325613 322 ts_manager.cc:194] Registered new tserver with Master: 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd (127.12.159.195:45013)
I20260923 19:40:39.326490 12927 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:40:39.326699 322 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.159.195:34925
I20260923 19:40:39.336491 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.330699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44320 (local address 127.12.159.254:45865)
0923 19:40:39.330941 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.330951 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.331274 (+ 323us) server_negotiation.cc:407] Connection header received
0923 19:40:39.331427 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.331433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.331504 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.331587 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:39.332048 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.332729 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.334172 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.334575 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.334670 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.335650 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:39.335655 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:39.335658 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:39.335674 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:39.335703 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:39.335714 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:39.335785 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.336046 (+ 261us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.336139 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:40:39.340407 322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:40:39.347564 322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:40:39.380414 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.371057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.12.159.194:38597)
0923 19:40:39.372515 (+ 1458us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.372527 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.373708 (+ 1181us) server_negotiation.cc:407] Connection header received
0923 19:40:39.373837 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.373846 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.374108 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.374309 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:39.374832 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.375974 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.378017 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.379230 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.379419 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.379652 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.379877 (+ 225us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.380050 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1209,"thread_start_us":1082,"threads_started":1}
I20260923 19:40:39.380491 785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.370743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:38597 (local address 127.0.0.1:59488)
0923 19:40:39.373486 (+ 2743us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.373506 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.373624 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.374314 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.374319 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.374344 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:39.374678 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.374688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.376124 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.376129 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.377738 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.377753 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.379429 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.379435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.379627 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.379679 (+ 52us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.379836 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.380050 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2609,"mutex_wait_us":21,"thread_start_us":2456,"threads_started":1}
I20260923 19:40:39.381182 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.360201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57044 (local address 127.12.159.195:45013)
0923 19:40:39.368389 (+ 8188us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.368402 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.370423 (+ 2021us) server_negotiation.cc:407] Connection header received
0923 19:40:39.370823 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.370834 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.371140 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.371341 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:39.373285 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.374829 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.377713 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.379251 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.379452 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.379653 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.380603 (+ 950us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.380794 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7953,"thread_start_us":9090,"threads_started":1}
I20260923 19:40:39.381247 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.360654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59092 (local address 127.12.159.193:35629)
0923 19:40:39.369744 (+ 9090us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.369756 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.370415 (+ 659us) server_negotiation.cc:407] Connection header received
0923 19:40:39.370841 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.370852 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.371098 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.371273 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:39.373783 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.375266 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.377882 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.379251 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.379447 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.379653 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.380742 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.380921 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8902,"thread_start_us":8795,"threads_started":1}
I20260923 19:40:39.382122 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.359958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:45013 (local address 127.0.0.1:57044)
0923 19:40:39.370262 (+ 10304us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.370310 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.370585 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.371767 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.371775 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.371826 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:39.373035 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.373050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.374952 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.374958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.377468 (+ 2510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.377483 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.379877 (+ 2394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.379884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.380232 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.380409 (+ 177us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.381508 (+ 1099us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.381630 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10013,"mutex_wait_us":180,"spinlock_wait_cycles":22912,"thread_start_us":9991,"threads_started":1}
I20260923 19:40:39.382129 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.360199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59092)
0923 19:40:39.370263 (+ 10064us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.370308 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.370582 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.371711 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.371723 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.371767 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:39.373035 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.373050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.375404 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.375411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.377624 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.377639 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.379888 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.379893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.380234 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.380409 (+ 175us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.381424 (+ 1015us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.381593 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9921,"mutex_wait_us":169,"spinlock_wait_cycles":12416,"thread_start_us":9609,"threads_started":1}
I20260923 19:40:39.384617 574 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2df44aea0f40fa99ba5416bfb05ef8 (DEFAULT_TABLE table=test-table [id=0bba9c90ddf146819b64a7fb3539339f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:39.385461 443 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2df44aea0f40fa99ba5416bfb05ef8 (DEFAULT_TABLE table=test-table [id=0bba9c90ddf146819b64a7fb3539339f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:39.385573 704 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2df44aea0f40fa99ba5416bfb05ef8 (DEFAULT_TABLE table=test-table [id=0bba9c90ddf146819b64a7fb3539339f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:40:39.386150 574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2df44aea0f40fa99ba5416bfb05ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:39.386600 508 heartbeater.cc:503] Master 127.12.159.254:45865 was elected leader, sending a full tablet report...
I20260923 19:40:39.386835 443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2df44aea0f40fa99ba5416bfb05ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:39.387001 704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2df44aea0f40fa99ba5416bfb05ef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:39.398396 787 tablet_bootstrap.cc:492] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Bootstrap starting.
I20260923 19:40:39.401919 788 tablet_bootstrap.cc:492] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Bootstrap starting.
I20260923 19:40:39.403028 787 tablet_bootstrap.cc:654] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:39.404609 787 log.cc:824] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:39.405633 788 tablet_bootstrap.cc:654] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:39.406854 788 log.cc:824] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:39.407994 787 tablet_bootstrap.cc:492] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: No bootstrap required, opened a new log
I20260923 19:40:39.408293 787 ts_tablet_manager.cc:1397] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260923 19:40:39.409924 788 tablet_bootstrap.cc:492] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: No bootstrap required, opened a new log
I20260923 19:40:39.409897 789 tablet_bootstrap.cc:492] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Bootstrap starting.
I20260923 19:40:39.410182 788 ts_tablet_manager.cc:1397] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260923 19:40:39.412760 789 tablet_bootstrap.cc:654] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:39.414094 789 log.cc:824] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:39.417405 789 tablet_bootstrap.cc:492] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: No bootstrap required, opened a new log
I20260923 19:40:39.417711 789 ts_tablet_manager.cc:1397] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260923 19:40:39.419687 787 raft_consensus.cc:348] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.420190 787 raft_consensus.cc:374] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:39.420288 787 raft_consensus.cc:729] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 292c535d422e42ecaf37fa72a177427a, State: Initialized, Role: FOLLOWER
I20260923 19:40:39.420929 788 raft_consensus.cc:348] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.421064 787 consensus_queue.cc:260] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.421357 788 raft_consensus.cc:374] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:39.421461 788 raft_consensus.cc:729] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd, State: Initialized, Role: FOLLOWER
I20260923 19:40:39.422148 788 consensus_queue.cc:260] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.423307 787 ts_tablet_manager.cc:1428] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Time spent starting tablet: real 0.015s user 0.006s sys 0.010s
I20260923 19:40:39.424314 769 heartbeater.cc:503] Master 127.12.159.254:45865 was elected leader, sending a full tablet report...
I20260923 19:40:39.424928 788 ts_tablet_manager.cc:1428] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260923 19:40:39.427001 789 raft_consensus.cc:348] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.427479 789 raft_consensus.cc:374] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:39.427623 789 raft_consensus.cc:729] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 944b41491cd1412391d101483a889d7e, State: Initialized, Role: FOLLOWER
I20260923 19:40:39.428298 789 consensus_queue.cc:260] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.429486 639 heartbeater.cc:503] Master 127.12.159.254:45865 was elected leader, sending a full tablet report...
I20260923 19:40:39.430203 789 ts_tablet_manager.cc:1428] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260923 19:40:39.473263 793 raft_consensus.cc:482] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:40:39.473569 793 raft_consensus.cc:504] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.475461 793 leader_election.cc:288] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd (127.12.159.195:45013), 944b41491cd1412391d101483a889d7e (127.12.159.194:38597)
I20260923 19:40:39.476377 795 raft_consensus.cc:482] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:40:39.476706 795 raft_consensus.cc:504] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.485247 795 leader_election.cc:288] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd (127.12.159.195:45013), 292c535d422e42ecaf37fa72a177427a (127.12.159.193:35629)
I20260923 19:40:39.488777 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.477164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:43373 (local address 127.12.159.194:38597)
0923 19:40:39.477348 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.477355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.477568 (+ 213us) server_negotiation.cc:407] Connection header received
0923 19:40:39.477783 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.477788 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.477929 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.478037 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:39.478530 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.479687 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.484051 (+ 4364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.485828 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.486006 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.486090 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.488254 (+ 2164us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.488450 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":60}
I20260923 19:40:39.489567 797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.476689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.194:38597 (local address 127.12.159.193:43373)
0923 19:40:39.477465 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.477482 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.477628 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.478060 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.478064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.478087 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:39.478381 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.478388 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.480693 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.480702 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.483753 (+ 3051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.483778 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.487841 (+ 4063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.487848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.488044 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.488083 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.489039 (+ 956us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.489215 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":678,"threads_started":1}
I20260923 19:40:39.489795 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.475834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.193:34847 (local address 127.12.159.195:45013)
0923 19:40:39.476035 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.476039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.476575 (+ 536us) server_negotiation.cc:407] Connection header received
0923 19:40:39.476896 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.476913 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.477010 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.477082 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:39.477962 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.479029 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.486593 (+ 7564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.488091 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.488253 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.488355 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.489282 (+ 927us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.489486 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:40:39.490618 594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "292c535d422e42ecaf37fa72a177427a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "944b41491cd1412391d101483a889d7e" is_pre_election: true
I20260923 19:40:39.490844 796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.475835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:45013 (local address 127.12.159.193:34847)
0923 19:40:39.476438 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.476458 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.476704 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.477298 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.477303 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.477330 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:39.477773 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.477786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.479212 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.479219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.486309 (+ 7090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.486332 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.488569 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.488579 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.488805 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.489099 (+ 294us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.490386 (+ 1287us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.490552 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":418,"threads_started":1}
I20260923 19:40:39.491135 594 raft_consensus.cc:2454] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292c535d422e42ecaf37fa72a177427a in term 0.
I20260923 19:40:39.492084 724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "292c535d422e42ecaf37fa72a177427a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" is_pre_election: true
I20260923 19:40:39.492538 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.479020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.195:45013 (local address 127.12.159.194:48463)
0923 19:40:39.480309 (+ 1289us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.480334 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.480497 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.481726 (+ 1229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.481730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.481756 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:39.482208 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.482224 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.484169 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.484175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.487570 (+ 3395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.487589 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.491451 (+ 3862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.491461 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.491693 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.491752 (+ 59us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.491838 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.492031 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1119,"mutex_wait_us":1,"thread_start_us":941,"threads_started":1}
I20260923 19:40:39.492683 724 raft_consensus.cc:2454] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 292c535d422e42ecaf37fa72a177427a in term 0.
I20260923 19:40:39.493008 396 leader_election.cc:302] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 292c535d422e42ecaf37fa72a177427a, 944b41491cd1412391d101483a889d7e; no voters:
I20260923 19:40:39.493436 793 raft_consensus.cc:2781] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:40:39.493568 793 raft_consensus.cc:482] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:40:39.493660 793 raft_consensus.cc:3037] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:39.493930 800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.479515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:48463 (local address 127.12.159.195:45013)
0923 19:40:39.481375 (+ 1860us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.481383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.481422 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:40:39.481491 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.481495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.481563 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.482365 (+ 802us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:39.482641 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.483997 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.489874 (+ 5877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.491204 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.493224 (+ 2020us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.493324 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.493380 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.493556 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1720,"thread_start_us":6505,"threads_started":1}
I20260923 19:40:39.494508 724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "944b41491cd1412391d101483a889d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" is_pre_election: true
I20260923 19:40:39.494771 724 raft_consensus.cc:2454] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 944b41491cd1412391d101483a889d7e in term 0.
I20260923 19:40:39.495250 527 leader_election.cc:302] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd, 944b41491cd1412391d101483a889d7e; no voters:
I20260923 19:40:39.495625 795 raft_consensus.cc:2781] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:40:39.495776 795 raft_consensus.cc:482] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:40:39.495894 795 raft_consensus.cc:3037] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:39.496647 793 raft_consensus.cc:504] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.497273 793 leader_election.cc:288] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [CANDIDATE]: Term 1 election: Requested vote from peers 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd (127.12.159.195:45013), 944b41491cd1412391d101483a889d7e (127.12.159.194:38597)
I20260923 19:40:39.497740 724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "292c535d422e42ecaf37fa72a177427a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd"
I20260923 19:40:39.497880 594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "292c535d422e42ecaf37fa72a177427a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "944b41491cd1412391d101483a889d7e"
I20260923 19:40:39.497982 724 raft_consensus.cc:3037] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:39.499223 795 raft_consensus.cc:504] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.499670 594 raft_consensus.cc:2379] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 292c535d422e42ecaf37fa72a177427a in current term 1: Already voted for candidate 944b41491cd1412391d101483a889d7e in this term.
I20260923 19:40:39.499933 795 leader_election.cc:288] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd (127.12.159.195:45013), 292c535d422e42ecaf37fa72a177427a (127.12.159.193:35629)
I20260923 19:40:39.500345 723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "944b41491cd1412391d101483a889d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd"
I20260923 19:40:39.500990 724 raft_consensus.cc:2454] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 292c535d422e42ecaf37fa72a177427a in term 1.
I20260923 19:40:39.501230 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.479670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.159.194:55667 (local address 127.12.159.193:35629)
0923 19:40:39.479859 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.479865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.493781 (+ 13916us) server_negotiation.cc:407] Connection header received
0923 19:40:39.493869 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.493876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.493989 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.494081 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:40:39.494618 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.495674 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.498019 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.499276 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.499420 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.499484 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.500844 (+ 1360us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.500994 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:40:39.501427 396 leader_election.cc:302] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 292c535d422e42ecaf37fa72a177427a, 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd; no voters: 944b41491cd1412391d101483a889d7e
I20260923 19:40:39.501749 793 raft_consensus.cc:2781] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:39.502027 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.479233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.12.159.194:55667)
0923 19:40:39.492846 (+ 13613us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.492864 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:40:39.492974 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:40:39.494235 (+ 1261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:40:39.494243 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:40:39.494272 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:40:39.494456 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.494467 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.495840 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.495847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.497793 (+ 1946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:40:39.497834 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.500350 (+ 2516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.500360 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:40:39.500630 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.500673 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 19:40:39.501450 (+ 777us) client_negotiation.cc:240] Negotiation successful
0923 19:40:39.501646 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13518,"thread_start_us":14503,"threads_started":1}
I20260923 19:40:39.502247 793 raft_consensus.cc:686] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 1 LEADER]: Becoming Leader. State: Replica: 292c535d422e42ecaf37fa72a177427a, State: Running, Role: LEADER
I20260923 19:40:39.502849 793 consensus_queue.cc:237] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } }
I20260923 19:40:39.503067 463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "944b41491cd1412391d101483a889d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292c535d422e42ecaf37fa72a177427a" is_pre_election: true
I20260923 19:40:39.503324 462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2df44aea0f40fa99ba5416bfb05ef8" candidate_uuid: "944b41491cd1412391d101483a889d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "292c535d422e42ecaf37fa72a177427a"
I20260923 19:40:39.504031 528 leader_election.cc:302] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 944b41491cd1412391d101483a889d7e; no voters: 292c535d422e42ecaf37fa72a177427a, 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd
I20260923 19:40:39.504732 795 raft_consensus.cc:2726] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260923 19:40:39.508051 320 catalog_manager.cc:5495] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a reported cstate change: term changed from 0 to 1, leader changed from <none> to 292c535d422e42ecaf37fa72a177427a (127.12.159.193). New cstate: current_term: 1 leader_uuid: "292c535d422e42ecaf37fa72a177427a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "292c535d422e42ecaf37fa72a177427a" member_type: VOTER last_known_addr { host: "127.12.159.193" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 } health_report { overall_health: UNKNOWN } } }
I20260923 19:40:39.532081 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.526701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59104 (local address 127.12.159.193:35629)
0923 19:40:39.526872 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.526877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.526967 (+ 90us) server_negotiation.cc:407] Connection header received
0923 19:40:39.527142 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.527146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.527263 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.527384 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:40:39.527724 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.528507 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.529964 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.530365 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.530457 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.530890 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:40:39.531465 (+ 575us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:40:39.531577 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.531675 (+ 98us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.531740 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:40:39.540676 724 raft_consensus.cc:1261] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 1 FOLLOWER]: Refusing update from remote peer 292c535d422e42ecaf37fa72a177427a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:39.540712 594 raft_consensus.cc:1261] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 1 FOLLOWER]: Refusing update from remote peer 292c535d422e42ecaf37fa72a177427a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:40:39.541642 793 consensus_queue.cc:1035] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [LEADER]: Connected to new peer: Peer: permanent_uuid: "944b41491cd1412391d101483a889d7e" member_type: VOTER last_known_addr { host: "127.12.159.194" port: 38597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:39.542171 801 consensus_queue.cc:1035] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bfbb60d5f3249c1ae9aa0d9f4e9a7cd" member_type: VOTER last_known_addr { host: "127.12.159.195" port: 45013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:40:39.558537 805 mvcc.cc:205] Tried to move back new op lower bound from 7332628232348205056 to 7332628232208572416. Current Snapshot: MvccSnapshot[applied={T|T < 7332628232348205056}]
I20260923 19:40:39.567749 320 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:39.568078 320 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:40:39.571614 320 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3cbea6d6f5c46ebb7acd7f0fdb77201: Sending DeleteTablet for 3 replicas of tablet 5c2df44aea0f40fa99ba5416bfb05ef8
I20260923 19:40:39.572777 443 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2df44aea0f40fa99ba5416bfb05ef8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:39 UTC) from {username='slave'} at 127.0.0.1:59092
I20260923 19:40:39.572856 704 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2df44aea0f40fa99ba5416bfb05ef8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:39 UTC) from {username='slave'} at 127.0.0.1:57044
I20260923 19:40:39.573722 813 tablet_replica.cc:330] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: stopping tablet replica
I20260923 19:40:39.573791 574 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2df44aea0f40fa99ba5416bfb05ef8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:40:39 UTC) from {username='slave'} at 127.0.0.1:59488
I20260923 19:40:39.574327 813 raft_consensus.cc:2229] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:39.574527 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 381
I20260923 19:40:39.574956 813 raft_consensus.cc:2258] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:39.577107 813 ts_tablet_manager.cc:1905] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:39.584453 813 ts_tablet_manager.cc:1918] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:39.584728 813 log.cc:1196] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-2/wal/wals/5c2df44aea0f40fa99ba5416bfb05ef8
I20260923 19:40:39.585421 813 ts_tablet_manager.cc:1939] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd: Deleting consensus metadata
I20260923 19:40:39.586661 814 tablet_replica.cc:330] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: stopping tablet replica
I20260923 19:40:39.587642 306 catalog_manager.cc:4841] TS 7bfbb60d5f3249c1ae9aa0d9f4e9a7cd (127.12.159.195:45013): tablet 5c2df44aea0f40fa99ba5416bfb05ef8 (table test-table [id=0bba9c90ddf146819b64a7fb3539339f]) successfully deleted
I20260923 19:40:39.587237 814 raft_consensus.cc:2229] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:40:39.589598 814 raft_consensus.cc:2258] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:39.592163 815 tablet_replica.cc:330] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: stopping tablet replica
I20260923 19:40:39.592559 815 raft_consensus.cc:2229] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:40:39.593029 815 raft_consensus.cc:2258] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:40:39.594695 814 ts_tablet_manager.cc:1905] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:39.599306 815 ts_tablet_manager.cc:1905] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:40:39.600793 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.577484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.12.159.193:35629)
0923 19:40:39.578016 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.578026 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.590376 (+ 12350us) server_negotiation.cc:407] Connection header received
0923 19:40:39.590685 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.590691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.590804 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.590880 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:39.591564 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.594815 (+ 3251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.596746 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.597439 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.597571 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.598891 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:39.598907 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:39.598924 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:39.599820 (+ 896us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:39.599901 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:39.599927 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:39.600016 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.600330 (+ 314us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.600439 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355}
I20260923 19:40:39.601866 814 ts_tablet_manager.cc:1918] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:39.602048 814 log.cc:1196] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-0/wal/wals/5c2df44aea0f40fa99ba5416bfb05ef8
I20260923 19:40:39.602280 503 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:39.607730 815 ts_tablet_manager.cc:1918] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:40:39.607894 815 log.cc:1196] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Deleting WAL directory at /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192117815085-12927-0/minicluster-data/ts-1/wal/wals/5c2df44aea0f40fa99ba5416bfb05ef8
I20260923 19:40:39.608354 815 ts_tablet_manager.cc:1939] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 944b41491cd1412391d101483a889d7e: Deleting consensus metadata
I20260923 19:40:39.609984 306 catalog_manager.cc:4841] TS 944b41491cd1412391d101483a889d7e (127.12.159.194:38597): tablet 5c2df44aea0f40fa99ba5416bfb05ef8 (table test-table [id=0bba9c90ddf146819b64a7fb3539339f]) successfully deleted
I20260923 19:40:39.700775 814 ts_tablet_manager.cc:1939] T 5c2df44aea0f40fa99ba5416bfb05ef8 P 292c535d422e42ecaf37fa72a177427a: Deleting consensus metadata
I20260923 19:40:39.701493 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 381
I20260923 19:40:39.720976 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 512
W20260923 19:40:39.720887 307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.159.193:35629 (error 108)
I20260923 19:40:39.722921 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.722425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59130)
0923 19:40:39.722619 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.722738 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260923 19:40:39.723150 307 catalog_manager.cc:4584] TS 292c535d422e42ecaf37fa72a177427a (127.12.159.193:35629): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c2df44aea0f40fa99ba5416bfb05ef8: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
I20260923 19:40:39.728423 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.721722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59502 (local address 127.12.159.194:38597)
0923 19:40:39.721963 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.721968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.722084 (+ 116us) server_negotiation.cc:407] Connection header received
0923 19:40:39.722302 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.722308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.722462 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.722584 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:39.723099 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.724022 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.725432 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.725981 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.726076 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.727040 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:39.727049 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:39.727062 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:39.727610 (+ 548us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:39.727655 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:39.727675 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:39.727769 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.727969 (+ 200us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.728112 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:40:39.729121 634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:39.776985 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.776463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59142)
0923 19:40:39.776711 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.776797 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260923 19:40:39.778455 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.778051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59152)
0923 19:40:39.778219 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.778324 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 19:40:39.834475 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 512
I20260923 19:40:39.838924 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.838320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59166)
0923 19:40:39.838576 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.838697 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260923 19:40:39.840031 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.839600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59174)
0923 19:40:39.839777 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.839872 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 19:40:39.852867 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 642
I20260923 19:40:39.860262 800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.853685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57054 (local address 127.12.159.195:45013)
0923 19:40:39.853917 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:39.853923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:39.854022 (+ 99us) server_negotiation.cc:407] Connection header received
0923 19:40:39.854238 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:39.854244 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:39.854356 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:39.854485 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:39.854963 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.855647 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.856939 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:39.857387 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:39.857530 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:39.858766 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:39.858775 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:39.858790 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:39.859434 (+ 644us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:39.859482 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:39.859502 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:39.859640 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:39.859770 (+ 130us) server_negotiation.cc:299] Negotiation successful
0923 19:40:39.859920 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:40:39.860913 764 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:39.921015 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.920469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59182)
0923 19:40:39.920725 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.920823 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260923 19:40:39.922323 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:39.921865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.193:35629 (local address 127.0.0.1:59188)
0923 19:40:39.922119 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0923 19:40:39.922198 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.193:35629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260923 19:40:39.953248 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 642
I20260923 19:40:39.969879 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 32759
I20260923 19:40:39.971088 352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:40.082929 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 32759
2026-09-23T19:40:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2821 ms)
[----------] 6 tests from EncryptionPolicyTest (21887 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:40 dist-test-slave-lzv7 krb5kdc[824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:40 dist-test-slave-lzv7 krb5kdc[824](info): set up 2 sockets
Sep 23 19:40:40 dist-test-slave-lzv7 krb5kdc[824](info): commencing operation
krb5kdc: starting...
W20260923 19:40:41.198297 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:41 dist-test-slave-lzv7 krb5kdc[824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:41.469357 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38733
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:41.806129 837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:41.806406 837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:41.806571 837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:41.814697 837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:41.814838 837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:41.814921 837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:41.815026 837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:41.815105 837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:41.825454 837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38733
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:41.826817 837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:41.828190 837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:41.840454 842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:41.840495 843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:41.840458 845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:41.841285 837 server_base.cc:1034] running on GCE node
I20260923 19:40:41.842199 837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:41.843719 837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:41.845021 837 hybrid_clock.cc:648] HybridClock initialized: now 1790192441844958 us; error 69 us; skew 500 ppm
I20260923 19:40:41.845405 837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:41 dist-test-slave-lzv7 krb5kdc[824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192441, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:41.848618 837 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:41.850150 837 webserver.cc:460] Webserver started at http://127.0.0.1:36413/ using document root <none> and password file <none>
I20260923 19:40:41.850818 837 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:41.850917 837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:41.851178 837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:41.854368 837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "cb8b198ab2bb4119ba5cf2d20964735e"
format_stamp: "Formatted at 2026-09-23 19:40:41 on dist-test-slave-lzv7"
server_key: "b4d9f2db45e7e7fda806d3a85f0ed805"
server_key_iv: "1840e4828e8fb3f14a15af3c043dd3d2"
server_key_version: "encryptionkey@0"
I20260923 19:40:41.855120 837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "cb8b198ab2bb4119ba5cf2d20964735e"
format_stamp: "Formatted at 2026-09-23 19:40:41 on dist-test-slave-lzv7"
server_key: "b4d9f2db45e7e7fda806d3a85f0ed805"
server_key_iv: "1840e4828e8fb3f14a15af3c043dd3d2"
server_key_version: "encryptionkey@0"
I20260923 19:40:41.860517 837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260923 19:40:41.864189 852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:41.865563 837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:40:41.865706 837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "cb8b198ab2bb4119ba5cf2d20964735e"
format_stamp: "Formatted at 2026-09-23 19:40:41 on dist-test-slave-lzv7"
server_key: "b4d9f2db45e7e7fda806d3a85f0ed805"
server_key_iv: "1840e4828e8fb3f14a15af3c043dd3d2"
server_key_version: "encryptionkey@0"
I20260923 19:40:41.865939 837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:41.892223 837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:41.896420 837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:41.896659 837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:41.915699 837 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38733
I20260923 19:40:41.915728 903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38733 every 8 connection(s)
I20260923 19:40:41.917109 837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:41.921020 904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:41.924322 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 837
I20260923 19:40:41.924585 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:41.925412 12927 external_mini_cluster.cc:1428] Setting key 9ef3d8f16fcdcdd7822cf9827524f22f
I20260923 19:40:41.933625 904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e: Bootstrap starting.
I20260923 19:40:41.936893 904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:41.938064 904 log.cc:824] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:40:41 dist-test-slave-lzv7 krb5kdc[824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:40:41.941200 904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e: No bootstrap required, opened a new log
I20260923 19:40:41.948637 907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:41.927656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43399 (local address 127.0.0.1:38733)
0923 19:40:41.928475 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:41.928488 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:41.928529 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:40:41.930273 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:41.930295 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:41.930725 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:41.931162 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:41.932687 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:41.934127 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:41.935429 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:41.936130 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:41.936327 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:41.940957 (+ 4630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:41.940966 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:41.940981 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:41.941016 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:41.944253 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:41.945091 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:41.945098 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:41.945104 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:41.945271 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:41.945787 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:41.945791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:41.945793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:41.946394 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:41.946750 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:41.947230 (+ 480us) server_negotiation.cc:299] Negotiation successful
0923 19:40:41.947568 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":372,"threads_started":1}
I20260923 19:40:41.949532 904 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38733 } }
I20260923 19:40:41.949949 904 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:41.950069 904 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb8b198ab2bb4119ba5cf2d20964735e, State: Initialized, Role: FOLLOWER
I20260923 19:40:41.950796 904 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38733 } }
I20260923 19:40:41.951108 904 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:41.951288 904 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:41.951514 904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:41.953176 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:41.954387 904 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38733 } }
I20260923 19:40:41.954895 904 leader_election.cc:302] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb8b198ab2bb4119ba5cf2d20964735e; no voters:
I20260923 19:40:41.955511 904 leader_election.cc:288] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:41.955655 909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:41.957542 904 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:41.961597 909 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [term 1 LEADER]: Becoming Leader. State: Replica: cb8b198ab2bb4119ba5cf2d20964735e, State: Running, Role: LEADER
I20260923 19:40:41.962393 909 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38733 } }
I20260923 19:40:41.966230 910 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38733 } } }
I20260923 19:40:41.966657 910 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:41.967330 912 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb8b198ab2bb4119ba5cf2d20964735e. Latest consensus state: current_term: 1 leader_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb8b198ab2bb4119ba5cf2d20964735e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38733 } } }
I20260923 19:40:41.967700 912 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:41.968473 926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:41.979732 926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:41.985599 907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:41.965961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56511 (local address 127.0.0.1:38733)
0923 19:40:41.966175 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:41.966182 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:41.966213 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:40:41.966278 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:41.966283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:41.966381 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:41.966506 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:41.968535 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:41.970121 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:41.972605 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:41.973561 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:41.973684 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:41.977667 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:41.977677 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:41.977686 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:41.977734 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:41.981656 (+ 3922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:41.982796 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:41.982803 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:41.982807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:41.982971 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:41.983625 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:41.983630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:41.983634 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:41.984042 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:41.984325 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:41.985016 (+ 691us) server_negotiation.cc:299] Negotiation successful
0923 19:40:41.985215 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:40:41.989032 931 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:40:41.992760 926 catalog_manager.cc:1347] Generated new cluster ID: 9aaa223a4ad74f5285bc3e396bc0abba
I20260923 19:40:41.992890 926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:42.002768 926 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:42.004233 926 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:42.017853 926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb8b198ab2bb4119ba5cf2d20964735e: Generated new TSK 0
I20260923 19:40:42.018700 926 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:42.024667 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 837
I20260923 19:40:42.025914 899 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:42.119204 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 837
W20260923 19:40:42.136528 822 connection.cc:535] client connection to 127.0.0.1:38733 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38733): Connection reset by peer (error 104)
2026-09-23T19:40:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2031 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:42 dist-test-slave-lzv7 krb5kdc[936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:42 dist-test-slave-lzv7 krb5kdc[936](info): set up 2 sockets
Sep 23 19:40:42 dist-test-slave-lzv7 krb5kdc[936](info): commencing operation
krb5kdc: starting...
W20260923 19:40:43.254148 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.004s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:43 dist-test-slave-lzv7 krb5kdc[936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:43.510107 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46823
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:43.848893 949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:43.849184 949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:43.849277 949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:43.857110 949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:43.857223 949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:43.857270 949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:43.857333 949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:43.857378 949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:43.867451 949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46823
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:43.868783 949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:43.870232 949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:43.882366 954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:43.882376 955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:43.882370 957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:43.884007 949 server_base.cc:1034] running on GCE node
I20260923 19:40:43.884831 949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:43.886421 949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:43.887668 949 hybrid_clock.cc:648] HybridClock initialized: now 1790192443887625 us; error 58 us; skew 500 ppm
I20260923 19:40:43.888072 949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:43 dist-test-slave-lzv7 krb5kdc[936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192443, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:43.898566 949 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:43.900239 949 webserver.cc:460] Webserver started at http://127.0.0.1:44481/ using document root <none> and password file <none>
I20260923 19:40:43.900996 949 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:43.901147 949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:43.901466 949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:43.905124 949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "38506144d24a464e9671ab91a2dd298f"
format_stamp: "Formatted at 2026-09-23 19:40:43 on dist-test-slave-lzv7"
server_key: "fc4ce20664e0d1e930f0d7c78ce2b9ef"
server_key_iv: "2ec32a8e80da9ab997f013a8f02a5050"
server_key_version: "encryptionkey@0"
I20260923 19:40:43.905994 949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "38506144d24a464e9671ab91a2dd298f"
format_stamp: "Formatted at 2026-09-23 19:40:43 on dist-test-slave-lzv7"
server_key: "fc4ce20664e0d1e930f0d7c78ce2b9ef"
server_key_iv: "2ec32a8e80da9ab997f013a8f02a5050"
server_key_version: "encryptionkey@0"
I20260923 19:40:43.911309 949 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:40:43.914955 964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:43.916347 949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:40:43.916558 949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "38506144d24a464e9671ab91a2dd298f"
format_stamp: "Formatted at 2026-09-23 19:40:43 on dist-test-slave-lzv7"
server_key: "fc4ce20664e0d1e930f0d7c78ce2b9ef"
server_key_iv: "2ec32a8e80da9ab997f013a8f02a5050"
server_key_version: "encryptionkey@0"
I20260923 19:40:43.916782 949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:43.933372 949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:43.937556 949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:43.937888 949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:43.957314 949 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46823
I20260923 19:40:43.957345 1015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46823 every 8 connection(s)
I20260923 19:40:43.958786 949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:43.962662 1016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:43.964730 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 949
I20260923 19:40:43.964913 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:43.965514 12927 external_mini_cluster.cc:1428] Setting key d666c82c4ecafbc31adafdeda6c893c5
I20260923 19:40:43.976068 1016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f: Bootstrap starting.
I20260923 19:40:43.978442 1019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:43.967414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34271 (local address 127.0.0.1:46823)
0923 19:40:43.968253 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:43.968265 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:43.968309 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:40:43.969986 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:43.970013 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:43.970428 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:43.970814 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:43.971356 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:43.972568 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:43.973933 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:43.974607 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:43.974799 (+ 192us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:43.976083 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:43.976090 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:43.976104 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:43.976678 (+ 574us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:43.976756 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:43.976782 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:43.976963 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:43.977262 (+ 299us) server_negotiation.cc:299] Negotiation successful
0923 19:40:43.977429 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":359,"threads_started":1}
I20260923 19:40:43.979507 1016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:43.980649 1016 log.cc:824] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:43.982506 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:43.984061 1016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f: No bootstrap required, opened a new log
I20260923 19:40:43.994846 1019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:43.987569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41417 (local address 127.0.0.1:46823)
0923 19:40:43.987752 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:43.987759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:43.988287 (+ 528us) server_negotiation.cc:407] Connection header received
0923 19:40:43.988440 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:43.988451 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:43.988538 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:43.988658 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:43.989200 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:43.990507 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:43.991893 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:43.992643 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:43.992783 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:43.993936 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:43.993943 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:43.993947 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:43.993969 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:43.994038 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:43.994061 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:43.994171 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:43.994441 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 19:40:43.994508 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:40:43.994526 1016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38506144d24a464e9671ab91a2dd298f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46823 } }
I20260923 19:40:43.995064 1016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:43.995195 1016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38506144d24a464e9671ab91a2dd298f, State: Initialized, Role: FOLLOWER
I20260923 19:40:43.995875 1016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38506144d24a464e9671ab91a2dd298f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46823 } }
I20260923 19:40:43.996145 1016 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:43.996301 1016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:43.996483 1016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:43.998800 1016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38506144d24a464e9671ab91a2dd298f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46823 } }
I20260923 19:40:43.999254 1016 leader_election.cc:302] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38506144d24a464e9671ab91a2dd298f; no voters:
I20260923 19:40:43.999861 1016 leader_election.cc:288] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:44.000095 1026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:44.000913 1026 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [term 1 LEADER]: Becoming Leader. State: Replica: 38506144d24a464e9671ab91a2dd298f, State: Running, Role: LEADER
I20260923 19:40:44.001482 1026 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38506144d24a464e9671ab91a2dd298f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46823 } }
I20260923 19:40:44.002161 1016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:44.011382 1027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38506144d24a464e9671ab91a2dd298f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38506144d24a464e9671ab91a2dd298f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46823 } } }
I20260923 19:40:44.011850 1027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:44.012583 1028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38506144d24a464e9671ab91a2dd298f. Latest consensus state: current_term: 1 leader_uuid: "38506144d24a464e9671ab91a2dd298f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38506144d24a464e9671ab91a2dd298f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46823 } } }
I20260923 19:40:44.012941 1028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:44.015136 1041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:44.019497 1041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:44.028893 1041 catalog_manager.cc:1347] Generated new cluster ID: 7f7d31b0346640b1a736005a247a0278
I20260923 19:40:44.029053 1041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:44.048085 1041 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:44.049583 1041 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:44.061692 1041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38506144d24a464e9671ab91a2dd298f: Generated new TSK 0
I20260923 19:40:44.062721 1041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:44.069205 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 949
W20260923 19:40:44.070534 1011 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34271
W20260923 19:40:44.071389 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 949: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:40:44.071594 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 949
W20260923 19:40:44.089200 934 connection.cc:535] client connection to 127.0.0.1:46823 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46823): Connection reset by peer (error 104)
2026-09-23T19:40:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1952 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:44 dist-test-slave-lzv7 krb5kdc[1047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:44 dist-test-slave-lzv7 krb5kdc[1047](info): set up 2 sockets
Sep 23 19:40:44 dist-test-slave-lzv7 krb5kdc[1047](info): commencing operation
krb5kdc: starting...
W20260923 19:40:45.186363 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:45 dist-test-slave-lzv7 krb5kdc[1047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:45.445711 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37841
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:45.785984 1060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:45.786348 1060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:45.786506 1060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:45.794157 1060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:45.794306 1060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:45.794411 1060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:45.794528 1060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:45.794607 1060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:45.806360 1060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37841
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:45.807747 1060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:45.809231 1060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:45.822781 1065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:45.822744 1066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:45.822821 1068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:45.824450 1060 server_base.cc:1034] running on GCE node
I20260923 19:40:45.825376 1060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:45.826982 1060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:45.828239 1060 hybrid_clock.cc:648] HybridClock initialized: now 1790192445828190 us; error 32 us; skew 500 ppm
I20260923 19:40:45.828649 1060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:45 dist-test-slave-lzv7 krb5kdc[1047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192445, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:45.831971 1060 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:45.833698 1060 webserver.cc:460] Webserver started at http://127.0.0.1:34681/ using document root <none> and password file <none>
I20260923 19:40:45.834467 1060 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:45.834625 1060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:45.834956 1060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:45.838217 1060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "84c89a5dc7724d949446866f09a30519"
format_stamp: "Formatted at 2026-09-23 19:40:45 on dist-test-slave-lzv7"
server_key: "00f57939d596159be88072379b32f743"
server_key_iv: "8276331bfc42a8c9532e619eadb30463"
server_key_version: "encryptionkey@0"
I20260923 19:40:45.839057 1060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "84c89a5dc7724d949446866f09a30519"
format_stamp: "Formatted at 2026-09-23 19:40:45 on dist-test-slave-lzv7"
server_key: "00f57939d596159be88072379b32f743"
server_key_iv: "8276331bfc42a8c9532e619eadb30463"
server_key_version: "encryptionkey@0"
I20260923 19:40:45.844548 1060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:40:45.848196 1075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:45.849588 1060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:40:45.849785 1060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "84c89a5dc7724d949446866f09a30519"
format_stamp: "Formatted at 2026-09-23 19:40:45 on dist-test-slave-lzv7"
server_key: "00f57939d596159be88072379b32f743"
server_key_iv: "8276331bfc42a8c9532e619eadb30463"
server_key_version: "encryptionkey@0"
I20260923 19:40:45.850068 1060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:45.856089 1060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:45.860445 1060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:45.860769 1060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:45.880118 1060 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37841
I20260923 19:40:45.880177 1126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37841 every 8 connection(s)
I20260923 19:40:45.881613 1060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:45.885499 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:45.890420 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1060
I20260923 19:40:45.890806 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:45.891319 12927 external_mini_cluster.cc:1428] Setting key 2adf5313ffbc3fb1c2aa581db118dd69
I20260923 19:40:45.896409 1127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519: Bootstrap starting.
I20260923 19:40:45.899555 1130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:45.893277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51845 (local address 127.0.0.1:37841)
0923 19:40:45.894176 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:45.894188 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:45.894234 (+ 46us) server_negotiation.cc:407] Connection header received
0923 19:40:45.896165 (+ 1931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:45.896189 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:45.896589 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:45.896950 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:45.898033 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:45.898039 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:45.898055 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:45.898069 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:45.898133 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:45.898155 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:45.898332 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:45.898433 (+ 101us) server_negotiation.cc:299] Negotiation successful
0923 19:40:45.898620 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":403,"threads_started":1}
I20260923 19:40:45.900091 1127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:45.901134 1127 log.cc:824] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:45.903450 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:45.904253 1127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519: No bootstrap required, opened a new log
I20260923 19:40:45.910382 1130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:45.907885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39573 (local address 127.0.0.1:37841)
0923 19:40:45.908124 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:45.908134 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:45.908462 (+ 328us) server_negotiation.cc:407] Connection header received
0923 19:40:45.908648 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:45.908655 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:45.908711 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:45.908793 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:45.909709 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:45.909713 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:45.909716 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:45.909729 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:45.909770 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:45.909785 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:45.909942 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:45.910041 (+ 99us) server_negotiation.cc:299] Negotiation successful
0923 19:40:45.910085 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:40:45.912882 1127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84c89a5dc7724d949446866f09a30519" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37841 } }
I20260923 19:40:45.913275 1127 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:45.913381 1127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84c89a5dc7724d949446866f09a30519, State: Initialized, Role: FOLLOWER
I20260923 19:40:45.914053 1127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84c89a5dc7724d949446866f09a30519" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37841 } }
I20260923 19:40:45.914299 1127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:45.914446 1127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:45.914635 1127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:45.916811 1127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84c89a5dc7724d949446866f09a30519" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37841 } }
I20260923 19:40:45.917299 1127 leader_election.cc:302] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84c89a5dc7724d949446866f09a30519; no voters:
I20260923 19:40:45.917946 1127 leader_election.cc:288] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:45.918104 1137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:45.918816 1137 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [term 1 LEADER]: Becoming Leader. State: Replica: 84c89a5dc7724d949446866f09a30519, State: Running, Role: LEADER
I20260923 19:40:45.919306 1137 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84c89a5dc7724d949446866f09a30519" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37841 } }
I20260923 19:40:45.920127 1127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:45.922474 1139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84c89a5dc7724d949446866f09a30519. Latest consensus state: current_term: 1 leader_uuid: "84c89a5dc7724d949446866f09a30519" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84c89a5dc7724d949446866f09a30519" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37841 } } }
I20260923 19:40:45.922854 1139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:45.923321 1138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84c89a5dc7724d949446866f09a30519" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84c89a5dc7724d949446866f09a30519" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37841 } } }
I20260923 19:40:45.923627 1138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:45.927047 1145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:45.934355 1145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:45.942911 1145 catalog_manager.cc:1347] Generated new cluster ID: 8c65966324cc4ef989facf2804018855
I20260923 19:40:45.943101 1145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:45.959139 1145 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:45.959635 1145 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:45.970616 1145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84c89a5dc7724d949446866f09a30519: Generated new TSK 0
I20260923 19:40:45.971495 1145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:45.978181 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1060
W20260923 19:40:45.979624 1122 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51845
W20260923 19:40:45.980363 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1060: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:40:45.980522 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1060
2026-09-23T19:40:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1908 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:46 dist-test-slave-lzv7 krb5kdc[1159](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:46 dist-test-slave-lzv7 krb5kdc[1159](info): set up 2 sockets
Sep 23 19:40:46 dist-test-slave-lzv7 krb5kdc[1159](info): commencing operation
krb5kdc: starting...
W20260923 19:40:47.130228 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:47 dist-test-slave-lzv7 krb5kdc[1159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:47.393481 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40043
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:47.745787 1172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:47.746198 1172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:47.746384 1172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:47.754093 1172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:47.754244 1172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:47.754355 1172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:47.754477 1172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:47.754565 1172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:47.766176 1172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:47.767654 1172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:47.769094 1172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:47.781713 1177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:47.781764 1180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:47.781795 1178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:47.783274 1172 server_base.cc:1034] running on GCE node
I20260923 19:40:47.784150 1172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:47.785717 1172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:47.786995 1172 hybrid_clock.cc:648] HybridClock initialized: now 1790192447786933 us; error 53 us; skew 500 ppm
I20260923 19:40:47.787396 1172 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:47 dist-test-slave-lzv7 krb5kdc[1159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192447, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:47.790874 1172 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:47.792564 1172 webserver.cc:460] Webserver started at http://127.0.0.1:43955/ using document root <none> and password file <none>
I20260923 19:40:47.793282 1172 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:47.793438 1172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:47.793753 1172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:47.796937 1172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "e6ade73d13464e51ab6e8ff6da749121"
format_stamp: "Formatted at 2026-09-23 19:40:47 on dist-test-slave-lzv7"
server_key: "5899a52fce2a0779c5cd8d0725773bb3"
server_key_iv: "330f819cd0963678d5b7eda4a5a9b280"
server_key_version: "encryptionkey@0"
I20260923 19:40:47.797794 1172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "e6ade73d13464e51ab6e8ff6da749121"
format_stamp: "Formatted at 2026-09-23 19:40:47 on dist-test-slave-lzv7"
server_key: "5899a52fce2a0779c5cd8d0725773bb3"
server_key_iv: "330f819cd0963678d5b7eda4a5a9b280"
server_key_version: "encryptionkey@0"
I20260923 19:40:47.803580 1172 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:40:47.807331 1187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:47.808905 1172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:40:47.809170 1172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "e6ade73d13464e51ab6e8ff6da749121"
format_stamp: "Formatted at 2026-09-23 19:40:47 on dist-test-slave-lzv7"
server_key: "5899a52fce2a0779c5cd8d0725773bb3"
server_key_iv: "330f819cd0963678d5b7eda4a5a9b280"
server_key_version: "encryptionkey@0"
I20260923 19:40:47.809394 1172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:47.821463 1172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:47.826222 1172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:47.826635 1172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:47.847280 1172 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40043
I20260923 19:40:47.847412 1238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40043 every 8 connection(s)
I20260923 19:40:47.848728 1172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:47.849431 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1172
I20260923 19:40:47.849633 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:47.850354 12927 external_mini_cluster.cc:1428] Setting key 72b38f05e4002d53efe7a72d0f5d1199
I20260923 19:40:47.853510 1239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:47.864343 1239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121: Bootstrap starting.
Sep 23 19:40:47 dist-test-slave-lzv7 krb5kdc[1159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:40:47.867761 1239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:47.869023 1239 log.cc:824] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:47.872560 1239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121: No bootstrap required, opened a new log
I20260923 19:40:47.874543 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:47.852355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39905 (local address 127.0.0.1:40043)
0923 19:40:47.853237 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:47.853250 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:47.853298 (+ 48us) server_negotiation.cc:407] Connection header received
0923 19:40:47.855202 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:47.855225 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:47.855622 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:47.856083 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:47.857774 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:47.859295 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:47.860710 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:47.861469 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:47.861741 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:47.866392 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:47.866401 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:47.866416 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:47.866458 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:47.870199 (+ 3741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:47.871143 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:47.871149 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:47.871156 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:47.871319 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:47.871740 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:47.871743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:47.871745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:47.872267 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:47.872486 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:47.873027 (+ 541us) server_negotiation.cc:299] Negotiation successful
0923 19:40:47.873418 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":440,"threads_started":1}
I20260923 19:40:47.878830 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:47.883076 1239 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ade73d13464e51ab6e8ff6da749121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40043 } }
I20260923 19:40:47.883600 1239 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:47.883711 1239 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6ade73d13464e51ab6e8ff6da749121, State: Initialized, Role: FOLLOWER
I20260923 19:40:47.884358 1239 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ade73d13464e51ab6e8ff6da749121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40043 } }
I20260923 19:40:47.884636 1239 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:47.884799 1239 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:47.884992 1239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:47.887426 1239 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ade73d13464e51ab6e8ff6da749121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40043 } }
I20260923 19:40:47.888044 1239 leader_election.cc:302] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6ade73d13464e51ab6e8ff6da749121; no voters:
I20260923 19:40:47.888751 1239 leader_election.cc:288] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:47.888952 1249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:47.889667 1249 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [term 1 LEADER]: Becoming Leader. State: Replica: e6ade73d13464e51ab6e8ff6da749121, State: Running, Role: LEADER
I20260923 19:40:47.890549 1249 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ade73d13464e51ab6e8ff6da749121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40043 } }
I20260923 19:40:47.894200 1239 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:47.895277 1251 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6ade73d13464e51ab6e8ff6da749121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ade73d13464e51ab6e8ff6da749121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40043 } } }
I20260923 19:40:47.895359 1250 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6ade73d13464e51ab6e8ff6da749121. Latest consensus state: current_term: 1 leader_uuid: "e6ade73d13464e51ab6e8ff6da749121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ade73d13464e51ab6e8ff6da749121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40043 } } }
I20260923 19:40:47.895727 1251 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:47.895759 1250 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:47.907992 1254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:47.908699 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:47.884340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46289 (local address 127.0.0.1:40043)
0923 19:40:47.884561 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:47.884570 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:47.885103 (+ 533us) server_negotiation.cc:407] Connection header received
0923 19:40:47.885317 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:47.885322 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:47.885402 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:47.885516 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:47.887308 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:47.888273 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:47.890377 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:47.891237 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:47.891407 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:47.895874 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:47.895884 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:47.895891 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:47.895952 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:47.902867 (+ 6915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:47.904668 (+ 1801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:47.904677 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:47.904683 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:47.904997 (+ 314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:47.905646 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:47.905654 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:47.905659 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:47.906194 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:47.906573 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:47.907910 (+ 1337us) server_negotiation.cc:299] Negotiation successful
0923 19:40:47.908155 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:40:47.914904 1254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:47.925006 1254 catalog_manager.cc:1347] Generated new cluster ID: bc5e1a047ffe4ba0bc40af07c196fef6
I20260923 19:40:47.925160 1254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:47.943746 1254 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:47.945163 1254 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:47.958895 1254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6ade73d13464e51ab6e8ff6da749121: Generated new TSK 0
I20260923 19:40:47.959837 1254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:47.978448 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1172
I20260923 19:40:47.979631 1234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:48.074816 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1172
2026-09-23T19:40:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2094 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:48 dist-test-slave-lzv7 krb5kdc[1271](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:48 dist-test-slave-lzv7 krb5kdc[1271](info): set up 2 sockets
Sep 23 19:40:48 dist-test-slave-lzv7 krb5kdc[1271](info): commencing operation
krb5kdc: starting...
W20260923 19:40:49.211452 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:49 dist-test-slave-lzv7 krb5kdc[1271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:49.481552 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42801
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:49.832510 1284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:49.832932 1284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:49.833130 1284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:49.843071 1284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:49.843228 1284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:49.843314 1284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:49.843411 1284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:49.843498 1284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:49.853780 1284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:49.855211 1284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:49.856555 1284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:49.868842 1290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:49.868903 1289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:49.868932 1292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:49.869958 1284 server_base.cc:1034] running on GCE node
I20260923 19:40:49.870833 1284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:49.872259 1284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:49.873472 1284 hybrid_clock.cc:648] HybridClock initialized: now 1790192449873441 us; error 48 us; skew 500 ppm
I20260923 19:40:49.873900 1284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:49 dist-test-slave-lzv7 krb5kdc[1271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192449, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:49.881516 1284 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:49.883180 1284 webserver.cc:460] Webserver started at http://127.0.0.1:39751/ using document root <none> and password file <none>
I20260923 19:40:49.883854 1284 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:49.883957 1284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:49.884214 1284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:49.887262 1284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "72e886d79c694507a13ba0d8d7a9c92a"
format_stamp: "Formatted at 2026-09-23 19:40:49 on dist-test-slave-lzv7"
server_key: "e0f74c856684f9da2d0a60f2a6c5b05b"
server_key_iv: "f4f18ee5b76b7d1410087c11f89f28d6"
server_key_version: "encryptionkey@0"
I20260923 19:40:49.887990 1284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "72e886d79c694507a13ba0d8d7a9c92a"
format_stamp: "Formatted at 2026-09-23 19:40:49 on dist-test-slave-lzv7"
server_key: "e0f74c856684f9da2d0a60f2a6c5b05b"
server_key_iv: "f4f18ee5b76b7d1410087c11f89f28d6"
server_key_version: "encryptionkey@0"
I20260923 19:40:49.893205 1284 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:40:49.896881 1299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:49.898414 1284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:40:49.898602 1284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "72e886d79c694507a13ba0d8d7a9c92a"
format_stamp: "Formatted at 2026-09-23 19:40:49 on dist-test-slave-lzv7"
server_key: "e0f74c856684f9da2d0a60f2a6c5b05b"
server_key_iv: "f4f18ee5b76b7d1410087c11f89f28d6"
server_key_version: "encryptionkey@0"
I20260923 19:40:49.898821 1284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:49.920502 1284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:49.924865 1284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:49.925179 1284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:49.944024 1284 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42801
I20260923 19:40:49.944072 1350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42801 every 8 connection(s)
I20260923 19:40:49.945513 1284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:49.947472 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1284
I20260923 19:40:49.947687 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:49.948242 12927 external_mini_cluster.cc:1428] Setting key cadd66af4caed3f007204ad88cef9a71
I20260923 19:40:49.950253 1351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:49.962534 1354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:49.950178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59935 (local address 127.0.0.1:42801)
0923 19:40:49.951044 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:49.951056 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:49.951097 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:40:49.952757 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:49.952778 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:49.953185 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:49.953522 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:49.954146 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:49.956070 (+ 1924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:49.957983 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:49.958632 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:49.958775 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:49.960068 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:49.960075 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:49.960091 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:49.960675 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:49.960751 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:49.960779 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:49.960881 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:49.961124 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 19:40:49.961422 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":402,"threads_started":1}
I20260923 19:40:49.963929 1351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a: Bootstrap starting.
I20260923 19:40:49.966564 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:49.967360 1351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:49.968398 1351 log.cc:824] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:49.971837 1351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a: No bootstrap required, opened a new log
I20260923 19:40:49.977052 1354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:49.971093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34573 (local address 127.0.0.1:42801)
0923 19:40:49.971297 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:49.971305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:49.971619 (+ 314us) server_negotiation.cc:407] Connection header received
0923 19:40:49.971822 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:49.971830 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:49.971890 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:49.971997 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:49.972525 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:49.973254 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:49.974624 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:49.975092 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:49.975236 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:49.976309 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:49.976313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:49.976316 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:49.976333 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:49.976375 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:49.976390 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:49.976504 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:49.976651 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 19:40:49.976742 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 19:40:49.979758 1351 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72e886d79c694507a13ba0d8d7a9c92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42801 } }
I20260923 19:40:49.980154 1351 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:49.980259 1351 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e886d79c694507a13ba0d8d7a9c92a, State: Initialized, Role: FOLLOWER
I20260923 19:40:49.981007 1351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72e886d79c694507a13ba0d8d7a9c92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42801 } }
I20260923 19:40:49.981338 1351 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:49.981530 1351 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:49.981719 1351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:49.984077 1351 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72e886d79c694507a13ba0d8d7a9c92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42801 } }
I20260923 19:40:49.984680 1351 leader_election.cc:302] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72e886d79c694507a13ba0d8d7a9c92a; no voters:
I20260923 19:40:49.985309 1351 leader_election.cc:288] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:49.985455 1361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:49.986208 1361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [term 1 LEADER]: Becoming Leader. State: Replica: 72e886d79c694507a13ba0d8d7a9c92a, State: Running, Role: LEADER
I20260923 19:40:49.986724 1361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72e886d79c694507a13ba0d8d7a9c92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42801 } }
I20260923 19:40:49.987457 1351 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:49.989609 1363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72e886d79c694507a13ba0d8d7a9c92a. Latest consensus state: current_term: 1 leader_uuid: "72e886d79c694507a13ba0d8d7a9c92a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72e886d79c694507a13ba0d8d7a9c92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42801 } } }
I20260923 19:40:49.990065 1363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:49.990856 1362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72e886d79c694507a13ba0d8d7a9c92a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72e886d79c694507a13ba0d8d7a9c92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42801 } } }
I20260923 19:40:49.991129 1362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:49.991750 1370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:49.997334 1370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:50.006368 1370 catalog_manager.cc:1347] Generated new cluster ID: 578fff922f1a4245b2df3ca4e123f374
I20260923 19:40:50.006507 1370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:50.034842 1370 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:50.036226 1370 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:50.050129 1370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72e886d79c694507a13ba0d8d7a9c92a: Generated new TSK 0
I20260923 19:40:50.050988 1370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:50.072005 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1284
W20260923 19:40:50.073414 1346 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59935
W20260923 19:40:50.074330 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1284: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:40:50.074505 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1284
2026-09-23T19:40:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1999 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:50 dist-test-slave-lzv7 krb5kdc[1382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:50 dist-test-slave-lzv7 krb5kdc[1382](info): set up 2 sockets
Sep 23 19:40:50 dist-test-slave-lzv7 krb5kdc[1382](info): commencing operation
krb5kdc: starting...
W20260923 19:40:51.182238 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.003s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:51 dist-test-slave-lzv7 krb5kdc[1382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:51.441359 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43895
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:51.782389 1395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:51.782665 1395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:51.782756 1395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:51.790112 1395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:51.790215 1395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:51.790272 1395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:51.790334 1395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:51.790380 1395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:51.800621 1395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:51.801987 1395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:51.803306 1395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:51.815917 1403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:51.816114 1401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:51.816116 1400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:51.817155 1395 server_base.cc:1034] running on GCE node
I20260923 19:40:51.818025 1395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:51.819515 1395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:51.820727 1395 hybrid_clock.cc:648] HybridClock initialized: now 1790192451820660 us; error 64 us; skew 500 ppm
I20260923 19:40:51.821105 1395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:51 dist-test-slave-lzv7 krb5kdc[1382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192451, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:51.824842 1395 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:51.826622 1395 webserver.cc:460] Webserver started at http://127.0.0.1:42517/ using document root <none> and password file <none>
I20260923 19:40:51.827342 1395 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:51.827450 1395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:51.827724 1395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:51.830979 1395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "6c0163777e124e2b8cf7677e08e782ac"
format_stamp: "Formatted at 2026-09-23 19:40:51 on dist-test-slave-lzv7"
server_key: "f2f5fe591a04243aa11e5536020e6cf1"
server_key_iv: "a6fc6c9c8d1d96e9aa3f1ee4c5d39196"
server_key_version: "encryptionkey@0"
I20260923 19:40:51.831743 1395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "6c0163777e124e2b8cf7677e08e782ac"
format_stamp: "Formatted at 2026-09-23 19:40:51 on dist-test-slave-lzv7"
server_key: "f2f5fe591a04243aa11e5536020e6cf1"
server_key_iv: "a6fc6c9c8d1d96e9aa3f1ee4c5d39196"
server_key_version: "encryptionkey@0"
I20260923 19:40:51.837219 1395 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:40:51.840792 1410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:51.842432 1395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:40:51.842665 1395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "6c0163777e124e2b8cf7677e08e782ac"
format_stamp: "Formatted at 2026-09-23 19:40:51 on dist-test-slave-lzv7"
server_key: "f2f5fe591a04243aa11e5536020e6cf1"
server_key_iv: "a6fc6c9c8d1d96e9aa3f1ee4c5d39196"
server_key_version: "encryptionkey@0"
I20260923 19:40:51.842938 1395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:51.849864 1395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:51.854569 1395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:51.854859 1395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:51.874444 1395 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43895
I20260923 19:40:51.874495 1461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43895 every 8 connection(s)
I20260923 19:40:51.875979 1395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:51.877431 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1395
I20260923 19:40:51.877609 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:51.878223 12927 external_mini_cluster.cc:1428] Setting key d8dfd473302e0e108b347f1c282446db
I20260923 19:40:51.880878 1462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:51.886469 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:51.880214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55245 (local address 127.0.0.1:43895)
0923 19:40:51.881076 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:51.881089 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:51.881130 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:40:51.882857 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:51.882880 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:51.883257 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:51.883672 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:51.884725 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:51.884731 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:51.884743 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:51.884757 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:51.884832 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:51.884852 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:51.885132 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:51.885278 (+ 146us) server_negotiation.cc:299] Negotiation successful
0923 19:40:51.885464 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":341,"threads_started":1}
I20260923 19:40:51.890378 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:51.892948 1462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac: Bootstrap starting.
I20260923 19:40:51.896445 1462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:51.897541 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:51.895083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46971 (local address 127.0.0.1:43895)
0923 19:40:51.895262 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:51.895268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:51.895641 (+ 373us) server_negotiation.cc:407] Connection header received
0923 19:40:51.895775 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:51.895780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:51.895840 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:51.895955 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:51.896915 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:51.896921 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:51.896927 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:51.896945 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:51.896991 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:51.897010 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:51.897125 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:51.897199 (+ 74us) server_negotiation.cc:299] Negotiation successful
0923 19:40:51.897253 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:40:51.897799 1462 log.cc:824] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:51.900887 1462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac: No bootstrap required, opened a new log
I20260923 19:40:51.908754 1462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0163777e124e2b8cf7677e08e782ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43895 } }
I20260923 19:40:51.909140 1462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:51.909260 1462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0163777e124e2b8cf7677e08e782ac, State: Initialized, Role: FOLLOWER
I20260923 19:40:51.909976 1462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0163777e124e2b8cf7677e08e782ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43895 } }
I20260923 19:40:51.910226 1462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:51.910378 1462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:51.910576 1462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:51.912806 1462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0163777e124e2b8cf7677e08e782ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43895 } }
I20260923 19:40:51.913250 1462 leader_election.cc:302] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c0163777e124e2b8cf7677e08e782ac; no voters:
I20260923 19:40:51.913873 1462 leader_election.cc:288] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:51.913980 1472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:51.914669 1472 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [term 1 LEADER]: Becoming Leader. State: Replica: 6c0163777e124e2b8cf7677e08e782ac, State: Running, Role: LEADER
I20260923 19:40:51.915256 1472 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0163777e124e2b8cf7677e08e782ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43895 } }
I20260923 19:40:51.916019 1462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:51.917860 1473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c0163777e124e2b8cf7677e08e782ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0163777e124e2b8cf7677e08e782ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43895 } } }
I20260923 19:40:51.918267 1473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:51.918316 1474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c0163777e124e2b8cf7677e08e782ac. Latest consensus state: current_term: 1 leader_uuid: "6c0163777e124e2b8cf7677e08e782ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0163777e124e2b8cf7677e08e782ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43895 } } }
I20260923 19:40:51.918596 1474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:51.920120 1477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:51.925647 1477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:51.935225 1477 catalog_manager.cc:1347] Generated new cluster ID: 506e28fd153e43d8a97963a7f6426b36
I20260923 19:40:51.935348 1477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:51.951300 1477 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:51.951802 1477 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:51.962831 1477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c0163777e124e2b8cf7677e08e782ac: Generated new TSK 0
I20260923 19:40:51.963883 1477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:51.973842 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1395
W20260923 19:40:51.974992 1457 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55245
W20260923 19:40:51.975687 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1395: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:40:51.975835 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1395
2026-09-23T19:40:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1901 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:52 dist-test-slave-lzv7 krb5kdc[1493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:52 dist-test-slave-lzv7 krb5kdc[1493](info): set up 2 sockets
Sep 23 19:40:52 dist-test-slave-lzv7 krb5kdc[1493](info): commencing operation
krb5kdc: starting...
W20260923 19:40:53.086272 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.009s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:53 dist-test-slave-lzv7 krb5kdc[1493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:53.344738 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42231
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:53.681391 1506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:53.681767 1506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:53.682049 1506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:53.689687 1506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:53.689905 1506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:53.690057 1506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:53.690171 1506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:53.690260 1506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:53.700706 1506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:53.702237 1506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:53.703714 1506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:53.715543 1512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:53.715588 1514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:53.715629 1511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:53.716524 1506 server_base.cc:1034] running on GCE node
I20260923 19:40:53.717289 1506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:53.718870 1506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:53.720127 1506 hybrid_clock.cc:648] HybridClock initialized: now 1790192453720097 us; error 45 us; skew 500 ppm
I20260923 19:40:53.720495 1506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:53 dist-test-slave-lzv7 krb5kdc[1493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192453, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:53.723594 1506 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:53.725029 1506 webserver.cc:460] Webserver started at http://127.0.0.1:34209/ using document root <none> and password file <none>
I20260923 19:40:53.725724 1506 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:53.725893 1506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:53.726210 1506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:53.729249 1506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "c8f01a38dbe74c99ae7cfeaf466a553e"
format_stamp: "Formatted at 2026-09-23 19:40:53 on dist-test-slave-lzv7"
server_key: "b18c6b353898a3b48738827194c4336f"
server_key_iv: "0d33b63cb31ed22522c3d648f679f612"
server_key_version: "encryptionkey@0"
I20260923 19:40:53.730111 1506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "c8f01a38dbe74c99ae7cfeaf466a553e"
format_stamp: "Formatted at 2026-09-23 19:40:53 on dist-test-slave-lzv7"
server_key: "b18c6b353898a3b48738827194c4336f"
server_key_iv: "0d33b63cb31ed22522c3d648f679f612"
server_key_version: "encryptionkey@0"
I20260923 19:40:53.735178 1506 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:40:53.738787 1521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:53.740198 1506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:40:53.740406 1506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "c8f01a38dbe74c99ae7cfeaf466a553e"
format_stamp: "Formatted at 2026-09-23 19:40:53 on dist-test-slave-lzv7"
server_key: "b18c6b353898a3b48738827194c4336f"
server_key_iv: "0d33b63cb31ed22522c3d648f679f612"
server_key_version: "encryptionkey@0"
I20260923 19:40:53.740626 1506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:53.771015 1506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:53.775264 1506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:53.775594 1506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:53.794641 1506 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42231
I20260923 19:40:53.794672 1572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42231 every 8 connection(s)
I20260923 19:40:53.796106 1506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:53.799829 1573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:53.800558 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1506
I20260923 19:40:53.800737 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:53.801208 12927 external_mini_cluster.cc:1428] Setting key 9ba6411f12b2899ead12a85bbeee1945
I20260923 19:40:53.812799 1573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e: Bootstrap starting.
Sep 23 19:40:53 dist-test-slave-lzv7 krb5kdc[1493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:40:53.816769 1573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:53.818004 1573 log.cc:824] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:53.821142 1573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e: No bootstrap required, opened a new log
I20260923 19:40:53.825318 1576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:53.803253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:54127 (local address 127.0.0.1:42231)
0923 19:40:53.804048 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:53.804062 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:53.804107 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:40:53.806124 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:53.806148 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:53.806604 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:53.807014 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:53.808833 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:53.810297 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:53.811599 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:53.812358 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:53.812578 (+ 220us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:53.817296 (+ 4718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:53.817304 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:53.817320 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:53.817365 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:53.820655 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:53.821624 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:53.821631 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:53.821638 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:53.821875 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:53.822402 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:53.822406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:53.822408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:53.822987 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:53.823343 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:53.823878 (+ 535us) server_negotiation.cc:299] Negotiation successful
0923 19:40:53.824246 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":335,"threads_started":1}
I20260923 19:40:53.829543 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:53.829893 1573 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42231 } }
I20260923 19:40:53.830315 1573 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:53.830411 1573 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f01a38dbe74c99ae7cfeaf466a553e, State: Initialized, Role: FOLLOWER
I20260923 19:40:53.831027 1573 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42231 } }
I20260923 19:40:53.831275 1573 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:53.831429 1573 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:53.831594 1573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:53.834407 1573 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42231 } }
I20260923 19:40:53.835150 1573 leader_election.cc:302] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8f01a38dbe74c99ae7cfeaf466a553e; no voters:
I20260923 19:40:53.835870 1573 leader_election.cc:288] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:53.835985 1583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:53.838788 1573 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:53.842602 1583 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [term 1 LEADER]: Becoming Leader. State: Replica: c8f01a38dbe74c99ae7cfeaf466a553e, State: Running, Role: LEADER
I20260923 19:40:53.843389 1583 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42231 } }
I20260923 19:40:53.847294 1584 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42231 } } }
I20260923 19:40:53.847445 1585 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8f01a38dbe74c99ae7cfeaf466a553e. Latest consensus state: current_term: 1 leader_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8f01a38dbe74c99ae7cfeaf466a553e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42231 } } }
I20260923 19:40:53.847766 1584 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:53.847833 1585 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:53.850123 1593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:53.857390 1576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:53.834785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:37033 (local address 127.0.0.1:42231)
0923 19:40:53.834963 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:53.834968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:53.835421 (+ 453us) server_negotiation.cc:407] Connection header received
0923 19:40:53.835611 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:53.835617 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:53.835699 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:53.835815 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:53.837570 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:53.838483 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:53.839849 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:53.840299 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:53.840448 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:53.843248 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:53.843258 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:53.843265 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:53.843320 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:53.847319 (+ 3999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:53.848622 (+ 1303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:53.848635 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:53.848641 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:53.848822 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:53.849319 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:53.849324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:53.849330 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:53.854859 (+ 5529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:53.856326 (+ 1467us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:53.856559 (+ 233us) server_negotiation.cc:299] Negotiation successful
0923 19:40:53.856846 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:40:53.861541 1593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:53.876205 1593 catalog_manager.cc:1347] Generated new cluster ID: e0f6e0fa58c84728bb2bff6b18abf2d5
I20260923 19:40:53.876343 1593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:53.886950 1593 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:53.888805 1593 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:53.905797 1593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8f01a38dbe74c99ae7cfeaf466a553e: Generated new TSK 0
I20260923 19:40:53.906941 1593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:53.916932 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1506
I20260923 19:40:53.918964 1568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:54.009943 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1506
W20260923 19:40:54.027395 1491 connection.cc:535] client connection to 127.0.0.1:42231 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42231): Connection reset by peer (error 104)
2026-09-23T19:40:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2033 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:54 dist-test-slave-lzv7 krb5kdc[1605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:54 dist-test-slave-lzv7 krb5kdc[1605](info): set up 2 sockets
Sep 23 19:40:54 dist-test-slave-lzv7 krb5kdc[1605](info): commencing operation
krb5kdc: starting...
W20260923 19:40:55.122337 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.006s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:55 dist-test-slave-lzv7 krb5kdc[1605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:55.380625 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40519
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:55.714061 1618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:55.714423 1618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:55.714593 1618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:55.722060 1618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:55.722220 1618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:55.722333 1618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:55.722453 1618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:55.722534 1618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:55.733083 1618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:55.734730 1618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:55.736116 1618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:55.748932 1623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:55.748955 1624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:55.748909 1626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:55.749755 1618 server_base.cc:1034] running on GCE node
I20260923 19:40:55.750586 1618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:55.752079 1618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:55.753301 1618 hybrid_clock.cc:648] HybridClock initialized: now 1790192455753262 us; error 27 us; skew 500 ppm
I20260923 19:40:55.753615 1618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:55 dist-test-slave-lzv7 krb5kdc[1605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192455, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:55.762171 1618 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:55.763737 1618 webserver.cc:460] Webserver started at http://127.0.0.1:41535/ using document root <none> and password file <none>
I20260923 19:40:55.764448 1618 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:55.764559 1618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:55.764814 1618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:55.767911 1618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "d7f3326c317241b49bdd3c98df836231"
format_stamp: "Formatted at 2026-09-23 19:40:55 on dist-test-slave-lzv7"
server_key: "c3d424d15d9e00f4b82460182ca1a27a"
server_key_iv: "c25fad5cc4be5c1097c20fd80d33c28c"
server_key_version: "encryptionkey@0"
I20260923 19:40:55.768647 1618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "d7f3326c317241b49bdd3c98df836231"
format_stamp: "Formatted at 2026-09-23 19:40:55 on dist-test-slave-lzv7"
server_key: "c3d424d15d9e00f4b82460182ca1a27a"
server_key_iv: "c25fad5cc4be5c1097c20fd80d33c28c"
server_key_version: "encryptionkey@0"
I20260923 19:40:55.773880 1618 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:40:55.777406 1633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:55.778803 1618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:40:55.778967 1618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "d7f3326c317241b49bdd3c98df836231"
format_stamp: "Formatted at 2026-09-23 19:40:55 on dist-test-slave-lzv7"
server_key: "c3d424d15d9e00f4b82460182ca1a27a"
server_key_iv: "c25fad5cc4be5c1097c20fd80d33c28c"
server_key_version: "encryptionkey@0"
I20260923 19:40:55.779143 1618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:55.807479 1618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:55.811892 1618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:55.812160 1618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:55.831523 1618 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40519
I20260923 19:40:55.831542 1684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40519 every 8 connection(s)
I20260923 19:40:55.833025 1618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:55.836066 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1618
I20260923 19:40:55.836289 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:55.836838 12927 external_mini_cluster.cc:1428] Setting key e9fe0efb77b42ade920e4a32068b8850
I20260923 19:40:55.837200 1685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:55.853004 1685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231: Bootstrap starting.
I20260923 19:40:55.853302 1688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:55.838870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:60565 (local address 127.0.0.1:40519)
0923 19:40:55.839730 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:55.839745 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:55.839795 (+ 50us) server_negotiation.cc:407] Connection header received
0923 19:40:55.842415 (+ 2620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:55.842447 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:55.843028 (+ 581us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:55.843521 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:55.844064 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:55.846166 (+ 2102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:55.847664 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:55.848750 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:55.848948 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:55.850429 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:55.850441 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:55.850460 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:55.851213 (+ 753us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:55.851312 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:55.851343 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:55.851512 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:55.851725 (+ 213us) server_negotiation.cc:299] Negotiation successful
0923 19:40:55.851902 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":365,"threads_started":1}
I20260923 19:40:55.856496 1685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:55.857402 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:55.857903 1685 log.cc:824] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:55.861773 1685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231: No bootstrap required, opened a new log
I20260923 19:40:55.870123 1688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:55.863001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:55491 (local address 127.0.0.1:40519)
0923 19:40:55.863233 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:55.863240 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:55.863562 (+ 322us) server_negotiation.cc:407] Connection header received
0923 19:40:55.863786 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:55.863790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:55.863873 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:55.863959 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:55.864585 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:55.865362 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:55.867387 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:55.867876 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:55.867981 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:55.869213 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:55.869219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:55.869227 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:55.869246 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:55.869310 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:55.869329 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:55.869437 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:55.869673 (+ 236us) server_negotiation.cc:299] Negotiation successful
0923 19:40:55.869757 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260923 19:40:55.872310 1685 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7f3326c317241b49bdd3c98df836231" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40519 } }
I20260923 19:40:55.872709 1685 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:55.872829 1685 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7f3326c317241b49bdd3c98df836231, State: Initialized, Role: FOLLOWER
I20260923 19:40:55.873420 1685 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7f3326c317241b49bdd3c98df836231" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40519 } }
I20260923 19:40:55.873654 1685 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:55.873831 1685 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:55.874030 1685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:55.876258 1685 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7f3326c317241b49bdd3c98df836231" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40519 } }
I20260923 19:40:55.876793 1685 leader_election.cc:302] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7f3326c317241b49bdd3c98df836231; no voters:
I20260923 19:40:55.877403 1685 leader_election.cc:288] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:55.877566 1695 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:55.879565 1685 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:55.881646 1695 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [term 1 LEADER]: Becoming Leader. State: Replica: d7f3326c317241b49bdd3c98df836231, State: Running, Role: LEADER
I20260923 19:40:55.882503 1695 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7f3326c317241b49bdd3c98df836231" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40519 } }
I20260923 19:40:55.886245 1697 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7f3326c317241b49bdd3c98df836231. Latest consensus state: current_term: 1 leader_uuid: "d7f3326c317241b49bdd3c98df836231" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7f3326c317241b49bdd3c98df836231" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40519 } } }
I20260923 19:40:55.886638 1697 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:55.887147 1696 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7f3326c317241b49bdd3c98df836231" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7f3326c317241b49bdd3c98df836231" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40519 } } }
I20260923 19:40:55.887455 1696 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231 [sys.catalog]: This master's current role is: LEADER
W20260923 19:40:55.890583 1709 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:40:55.890720 1709 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:40:55.890916 1710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:55.892660 1710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:55.901109 1710 catalog_manager.cc:1347] Generated new cluster ID: 5e816a2899e14ddc81ea75073539a128
I20260923 19:40:55.901222 1710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:55.932124 1710 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:55.933454 1710 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:55.940191 1710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7f3326c317241b49bdd3c98df836231: Generated new TSK 0
I20260923 19:40:55.941039 1710 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:55.949561 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1618
W20260923 19:40:55.950713 1680 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.63:60565
W20260923 19:40:55.951437 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1618: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:40:55.951575 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1618
W20260923 19:40:55.968851 1603 connection.cc:535] client connection to 127.0.0.1:40519 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40519): Connection reset by peer (error 104)
2026-09-23T19:40:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1941 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:56 dist-test-slave-lzv7 krb5kdc[1716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:56 dist-test-slave-lzv7 krb5kdc[1716](info): set up 2 sockets
Sep 23 19:40:56 dist-test-slave-lzv7 krb5kdc[1716](info): commencing operation
krb5kdc: starting...
W20260923 19:40:57.062179 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.007s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:57 dist-test-slave-lzv7 krb5kdc[1716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:57.319367 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:57.673643 1729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:57.674196 1729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:57.674393 1729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:57.682955 1729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:57.683130 1729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:57.683230 1729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:57.683348 1729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:57.683425 1729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:57.693852 1729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:57.695247 1729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:57.696650 1729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:57.709179 1735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:57.709131 1737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:57.709206 1734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:57.710206 1729 server_base.cc:1034] running on GCE node
I20260923 19:40:57.711054 1729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:57.712738 1729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:57.713975 1729 hybrid_clock.cc:648] HybridClock initialized: now 1790192457713938 us; error 38 us; skew 500 ppm
I20260923 19:40:57.714359 1729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:57 dist-test-slave-lzv7 krb5kdc[1716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192457, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:57.717545 1729 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:57.719204 1729 webserver.cc:460] Webserver started at http://127.0.0.1:45257/ using document root <none> and password file <none>
I20260923 19:40:57.719957 1729 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:57.720105 1729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:57.720429 1729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:57.723640 1729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "afc3ab4bda714f2d98ed772f67c99dd5"
format_stamp: "Formatted at 2026-09-23 19:40:57 on dist-test-slave-lzv7"
server_key: "ae9d10bb2e8666ec2da0a0f79cee261c"
server_key_iv: "3224ea6744beaabf319f701033db4d24"
server_key_version: "encryptionkey@0"
I20260923 19:40:57.724428 1729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "afc3ab4bda714f2d98ed772f67c99dd5"
format_stamp: "Formatted at 2026-09-23 19:40:57 on dist-test-slave-lzv7"
server_key: "ae9d10bb2e8666ec2da0a0f79cee261c"
server_key_iv: "3224ea6744beaabf319f701033db4d24"
server_key_version: "encryptionkey@0"
I20260923 19:40:57.729897 1729 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:40:57.733538 1744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:57.735114 1729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:40:57.735317 1729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "afc3ab4bda714f2d98ed772f67c99dd5"
format_stamp: "Formatted at 2026-09-23 19:40:57 on dist-test-slave-lzv7"
server_key: "ae9d10bb2e8666ec2da0a0f79cee261c"
server_key_iv: "3224ea6744beaabf319f701033db4d24"
server_key_version: "encryptionkey@0"
I20260923 19:40:57.735558 1729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:57.741546 1729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:57.745760 1729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:57.746125 1729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:57.765071 1729 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34785
I20260923 19:40:57.765106 1795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34785 every 8 connection(s)
I20260923 19:40:57.766558 1729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:57.770443 1796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:57.774219 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1729
I20260923 19:40:57.774417 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:57.774840 12927 external_mini_cluster.cc:1428] Setting key 84b73a9104ac4cc6078a8addb6c40c36
I20260923 19:40:57.782800 1799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:57.776815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:49629 (local address 127.0.0.1:34785)
0923 19:40:57.777617 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:57.777633 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:57.777676 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:40:57.779332 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:57.779356 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:57.779716 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:57.780067 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:57.781161 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:57.781168 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:57.781185 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:57.781198 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:57.781262 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:57.781282 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:57.781470 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:57.781612 (+ 142us) server_negotiation.cc:299] Negotiation successful
0923 19:40:57.781852 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":359,"threads_started":1}
I20260923 19:40:57.783435 1796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5: Bootstrap starting.
I20260923 19:40:57.786582 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:57.786911 1796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:57.787971 1796 log.cc:824] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:57.791429 1796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5: No bootstrap required, opened a new log
I20260923 19:40:57.793896 1799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:57.791175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:37345 (local address 127.0.0.1:34785)
0923 19:40:57.791377 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:57.791385 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:57.791794 (+ 409us) server_negotiation.cc:407] Connection header received
0923 19:40:57.792018 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:57.792023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:57.792069 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:57.792177 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:57.793160 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:57.793165 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:57.793168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:40:57.793185 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:57.793224 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:40:57.793241 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:57.793376 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:57.793506 (+ 130us) server_negotiation.cc:299] Negotiation successful
0923 19:40:57.793572 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:40:57.799865 1796 raft_consensus.cc:348] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260923 19:40:57.800263 1796 raft_consensus.cc:374] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:57.800384 1796 raft_consensus.cc:729] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afc3ab4bda714f2d98ed772f67c99dd5, State: Initialized, Role: FOLLOWER
I20260923 19:40:57.800981 1796 consensus_queue.cc:260] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260923 19:40:57.801221 1796 raft_consensus.cc:388] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:57.801376 1796 raft_consensus.cc:482] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:57.801577 1796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:57.804052 1796 raft_consensus.cc:504] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260923 19:40:57.804674 1796 leader_election.cc:302] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afc3ab4bda714f2d98ed772f67c99dd5; no voters:
I20260923 19:40:57.805284 1796 leader_election.cc:288] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:57.805434 1806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:57.806970 1806 raft_consensus.cc:686] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [term 1 LEADER]: Becoming Leader. State: Replica: afc3ab4bda714f2d98ed772f67c99dd5, State: Running, Role: LEADER
I20260923 19:40:57.807512 1796 sys_catalog.cc:564] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:57.807493 1806 consensus_queue.cc:237] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } }
I20260923 19:40:57.811005 1808 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afc3ab4bda714f2d98ed772f67c99dd5. Latest consensus state: current_term: 1 leader_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } } }
I20260923 19:40:57.811470 1808 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:57.810997 1807 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc3ab4bda714f2d98ed772f67c99dd5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34785 } } }
I20260923 19:40:57.813342 1807 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:57.819231 1816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:57.823779 1816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:57.832320 1816 catalog_manager.cc:1347] Generated new cluster ID: 5dddceb93dc447769ba94150e1ea8f97
I20260923 19:40:57.832459 1816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:57.850402 1816 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:57.850847 1816 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:57.857019 1816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afc3ab4bda714f2d98ed772f67c99dd5: Generated new TSK 0
I20260923 19:40:57.857999 1816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:57.874711 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1729
W20260923 19:40:57.875985 1791 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.63:49629
W20260923 19:40:57.876765 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1729: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:40:57.876932 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1729
2026-09-23T19:40:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1925 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:40:57 dist-test-slave-lzv7 krb5kdc[1827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:40:57 dist-test-slave-lzv7 krb5kdc[1827](info): set up 2 sockets
Sep 23 19:40:57 dist-test-slave-lzv7 krb5kdc[1827](info): commencing operation
krb5kdc: starting...
W20260923 19:40:59.002345 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.008s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:40:59 dist-test-slave-lzv7 krb5kdc[1827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:40:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:40:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:40:59.269249 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46619
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:40:59.611263 1840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:40:59.611553 1840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:40:59.611726 1840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:40:59.619208 1840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:40:59.619336 1840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:40:59.619449 1840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:40:59.619558 1840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:40:59.619645 1840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:40:59.629732 1840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46619
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:40:59.631115 1840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:40:59.632417 1840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:40:59.644361 1845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:59.644551 1848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:40:59.644788 1846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:40:59.645478 1840 server_base.cc:1034] running on GCE node
I20260923 19:40:59.646318 1840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:40:59.647804 1840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:40:59.649013 1840 hybrid_clock.cc:648] HybridClock initialized: now 1790192459648977 us; error 37 us; skew 500 ppm
I20260923 19:40:59.649391 1840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:40:59 dist-test-slave-lzv7 krb5kdc[1827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192459, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:40:59.652559 1840 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:40:59.654147 1840 webserver.cc:460] Webserver started at http://127.0.0.1:41725/ using document root <none> and password file <none>
I20260923 19:40:59.654835 1840 fs_manager.cc:359] Metadata directory not provided
I20260923 19:40:59.654983 1840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:40:59.655285 1840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:40:59.658303 1840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "37e3a73b16d54b6a867603acb8dc3902"
format_stamp: "Formatted at 2026-09-23 19:40:59 on dist-test-slave-lzv7"
server_key: "c7037bbf86ec8a273755edbda5fcdd4e"
server_key_iv: "00c00e5382e9a6dd3d889a53c74fc745"
server_key_version: "encryptionkey@0"
I20260923 19:40:59.659087 1840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "37e3a73b16d54b6a867603acb8dc3902"
format_stamp: "Formatted at 2026-09-23 19:40:59 on dist-test-slave-lzv7"
server_key: "c7037bbf86ec8a273755edbda5fcdd4e"
server_key_iv: "00c00e5382e9a6dd3d889a53c74fc745"
server_key_version: "encryptionkey@0"
I20260923 19:40:59.664458 1840 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260923 19:40:59.668035 1855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:40:59.669305 1840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:40:59.669505 1840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "37e3a73b16d54b6a867603acb8dc3902"
format_stamp: "Formatted at 2026-09-23 19:40:59 on dist-test-slave-lzv7"
server_key: "c7037bbf86ec8a273755edbda5fcdd4e"
server_key_iv: "00c00e5382e9a6dd3d889a53c74fc745"
server_key_version: "encryptionkey@0"
I20260923 19:40:59.669709 1840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:40:59.688843 1840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:40:59.693718 1840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:40:59.694084 1840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:40:59.713934 1840 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46619
I20260923 19:40:59.714025 1906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46619 every 8 connection(s)
I20260923 19:40:59.715457 1840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:40:59.719436 1907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:40:59.724766 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1840
I20260923 19:40:59.724989 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:40:59.725461 12927 external_mini_cluster.cc:1428] Setting key ed295195acc6a00d1d7fc7978fd6f764
I20260923 19:40:59.730695 1907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902: Bootstrap starting.
I20260923 19:40:59.734669 1907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902: Neither blocks nor log segments found. Creating new log.
I20260923 19:40:59.735983 1907 log.cc:824] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902: Log is configured to *not* fsync() on all Append() calls
I20260923 19:40:59.739787 1907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902: No bootstrap required, opened a new log
Sep 23 19:40:59 dist-test-slave-lzv7 krb5kdc[1827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:40:59.748306 1907 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e3a73b16d54b6a867603acb8dc3902" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46619 } }
I20260923 19:40:59.748744 1907 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:40:59.748886 1907 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e3a73b16d54b6a867603acb8dc3902, State: Initialized, Role: FOLLOWER
I20260923 19:40:59.749694 1907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e3a73b16d54b6a867603acb8dc3902" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46619 } }
I20260923 19:40:59.750039 1907 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:40:59.750198 1907 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:40:59.750411 1907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:40:59.750437 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:59.727362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:58789 (local address 127.0.0.1:46619)
0923 19:40:59.728230 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:59.728243 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:59.728288 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:40:59.730042 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:59.730066 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:59.730486 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:59.730859 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:59.732694 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:59.734152 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:59.736030 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:59.737108 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:59.737344 (+ 236us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:59.742286 (+ 4942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:59.742296 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:59.742311 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:59.742359 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:59.745724 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:59.746697 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:59.746704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:59.746711 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:59.746897 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:59.747405 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:59.747412 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:59.747414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:59.747964 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:59.748313 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:59.748812 (+ 499us) server_negotiation.cc:299] Negotiation successful
0923 19:40:59.749200 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":397,"threads_started":1}
I20260923 19:40:59.753494 1907 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e3a73b16d54b6a867603acb8dc3902" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46619 } }
I20260923 19:40:59.754138 1907 leader_election.cc:302] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37e3a73b16d54b6a867603acb8dc3902; no voters:
I20260923 19:40:59.754750 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:40:59.754823 1907 leader_election.cc:288] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:40:59.754949 1912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:40:59.757486 1907 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:40:59.761983 1912 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [term 1 LEADER]: Becoming Leader. State: Replica: 37e3a73b16d54b6a867603acb8dc3902, State: Running, Role: LEADER
I20260923 19:40:59.762888 1912 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e3a73b16d54b6a867603acb8dc3902" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46619 } }
I20260923 19:40:59.771723 1913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37e3a73b16d54b6a867603acb8dc3902" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e3a73b16d54b6a867603acb8dc3902" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46619 } } }
I20260923 19:40:59.772217 1913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:59.773388 1914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37e3a73b16d54b6a867603acb8dc3902. Latest consensus state: current_term: 1 leader_uuid: "37e3a73b16d54b6a867603acb8dc3902" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e3a73b16d54b6a867603acb8dc3902" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46619 } } }
I20260923 19:40:59.773888 1914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902 [sys.catalog]: This master's current role is: LEADER
I20260923 19:40:59.775228 1931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:40:59.780613 1931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:40:59.783154 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:40:59.764797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:41589 (local address 127.0.0.1:46619)
0923 19:40:59.765056 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0923 19:40:59.765065 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:40:59.765574 (+ 509us) server_negotiation.cc:407] Connection header received
0923 19:40:59.765847 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:40:59.765853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:40:59.765933 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:40:59.766040 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:40:59.767444 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:59.768220 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:59.769463 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:40:59.770011 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:40:59.770145 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:40:59.775606 (+ 5461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:40:59.775617 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:40:59.775621 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:40:59.775666 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:40:59.779466 (+ 3800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:59.780501 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:59.780506 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:59.780510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:59.780747 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:40:59.781321 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:40:59.781326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:40:59.781330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:40:59.781792 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:40:59.782106 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0923 19:40:59.782588 (+ 482us) server_negotiation.cc:299] Negotiation successful
0923 19:40:59.782775 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:40:59.789701 1931 catalog_manager.cc:1347] Generated new cluster ID: 029f99485ef84d71bf7409e0dc508043
I20260923 19:40:59.789855 1931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:40:59.802054 1931 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:40:59.803776 1931 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:40:59.815781 1931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37e3a73b16d54b6a867603acb8dc3902: Generated new TSK 0
I20260923 19:40:59.816769 1931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:40:59.832661 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1840
I20260923 19:40:59.833773 1902 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:40:59.928851 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1840
W20260923 19:40:59.943117 1825 connection.cc:535] client connection to 127.0.0.1:46619 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46619): Connection reset by peer (error 104)
2026-09-23T19:40:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2048 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:00 dist-test-slave-lzv7 krb5kdc[1939](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:00 dist-test-slave-lzv7 krb5kdc[1939](info): set up 2 sockets
Sep 23 19:41:00 dist-test-slave-lzv7 krb5kdc[1939](info): commencing operation
krb5kdc: starting...
W20260923 19:41:01.034332 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:01 dist-test-slave-lzv7 krb5kdc[1939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192461, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:41:01.293242 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:01.634948 1952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:01.635245 1952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:01.635337 1952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:01.642650 1952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:01.642771 1952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:01.642818 1952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:01.642870 1952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:01.642915 1952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:01.652968 1952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39937
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:01.654281 1952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:01.655592 1952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:01.667418 1957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:01.667515 1960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:01.667448 1958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:01.668313 1952 server_base.cc:1034] running on GCE node
I20260923 19:41:01.669106 1952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:01.670606 1952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:01.671833 1952 hybrid_clock.cc:648] HybridClock initialized: now 1790192461671782 us; error 46 us; skew 500 ppm
I20260923 19:41:01.672184 1952 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:01 dist-test-slave-lzv7 krb5kdc[1939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192461, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:01.682081 1952 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:41:01.683729 1952 webserver.cc:460] Webserver started at http://127.0.0.1:34239/ using document root <none> and password file <none>
I20260923 19:41:01.684455 1952 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:01.684604 1952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:01.684913 1952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:01.687974 1952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "73f5c76080e44a6fb8581fe5dee7b470"
format_stamp: "Formatted at 2026-09-23 19:41:01 on dist-test-slave-lzv7"
server_key: "092118ff8527e03a7e98915eedf28849"
server_key_iv: "83285b793195720e54a861d4201e861b"
server_key_version: "encryptionkey@0"
I20260923 19:41:01.688746 1952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "73f5c76080e44a6fb8581fe5dee7b470"
format_stamp: "Formatted at 2026-09-23 19:41:01 on dist-test-slave-lzv7"
server_key: "092118ff8527e03a7e98915eedf28849"
server_key_iv: "83285b793195720e54a861d4201e861b"
server_key_version: "encryptionkey@0"
I20260923 19:41:01.694216 1952 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260923 19:41:01.697887 1967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:01.699327 1952 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:01.699530 1952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "73f5c76080e44a6fb8581fe5dee7b470"
format_stamp: "Formatted at 2026-09-23 19:41:01 on dist-test-slave-lzv7"
server_key: "092118ff8527e03a7e98915eedf28849"
server_key_iv: "83285b793195720e54a861d4201e861b"
server_key_version: "encryptionkey@0"
I20260923 19:41:01.699739 1952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:01.721876 1952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:01.726198 1952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:01.726497 1952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:01.745447 1952 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39937
I20260923 19:41:01.745472 2018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39937 every 8 connection(s)
I20260923 19:41:01.746974 1952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:01.749233 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 1952
I20260923 19:41:01.749442 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:01.749972 12927 external_mini_cluster.cc:1428] Setting key 230b32d5af0dca1054b2bb74c7d8a263
I20260923 19:41:01.751278 2019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:01.763756 2022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:01.751784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:55927 (local address 127.0.0.1:39937)
0923 19:41:01.752578 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:01.752590 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:01.752630 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:41:01.754353 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:01.754382 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:01.754800 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:01.755155 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:01.755771 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:01.757102 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:01.759070 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:01.759767 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:01.759910 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:01.761249 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:01.761256 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:01.761271 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:01.761974 (+ 703us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:01.762052 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:01.762078 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:01.762209 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:01.762529 (+ 320us) server_negotiation.cc:299] Negotiation successful
0923 19:41:01.762733 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":350,"threads_started":1}
I20260923 19:41:01.765352 2019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470: Bootstrap starting.
I20260923 19:41:01.767880 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:01.768870 2019 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:01.769949 2019 log.cc:824] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:01.773363 2019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470: No bootstrap required, opened a new log
I20260923 19:41:01.779281 2022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:01.772538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:39711 (local address 127.0.0.1:39937)
0923 19:41:01.772708 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:01.772714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:01.773082 (+ 368us) server_negotiation.cc:407] Connection header received
0923 19:41:01.773234 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:01.773239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:01.773314 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:01.773445 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:01.774052 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:01.775157 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:01.776465 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:01.777183 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:01.777328 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:01.778463 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:01.778470 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:01.778474 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:01.778497 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:01.778557 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:01.778584 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:01.778713 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:01.778866 (+ 153us) server_negotiation.cc:299] Negotiation successful
0923 19:41:01.778929 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:41:01.782853 2019 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f5c76080e44a6fb8581fe5dee7b470" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 19:41:01.783217 2019 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:01.783291 2019 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73f5c76080e44a6fb8581fe5dee7b470, State: Initialized, Role: FOLLOWER
I20260923 19:41:01.783869 2019 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f5c76080e44a6fb8581fe5dee7b470" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 19:41:01.784075 2019 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:01.784173 2019 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:01.784303 2019 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:01.786571 2019 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f5c76080e44a6fb8581fe5dee7b470" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 19:41:01.787101 2019 leader_election.cc:302] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73f5c76080e44a6fb8581fe5dee7b470; no voters:
I20260923 19:41:01.787663 2019 leader_election.cc:288] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:01.787808 2029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:01.788524 2029 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [term 1 LEADER]: Becoming Leader. State: Replica: 73f5c76080e44a6fb8581fe5dee7b470, State: Running, Role: LEADER
I20260923 19:41:01.789112 2029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f5c76080e44a6fb8581fe5dee7b470" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } }
I20260923 19:41:01.789881 2019 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:01.792158 2030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73f5c76080e44a6fb8581fe5dee7b470" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f5c76080e44a6fb8581fe5dee7b470" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } } }
I20260923 19:41:01.792109 2031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73f5c76080e44a6fb8581fe5dee7b470. Latest consensus state: current_term: 1 leader_uuid: "73f5c76080e44a6fb8581fe5dee7b470" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f5c76080e44a6fb8581fe5dee7b470" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39937 } } }
I20260923 19:41:01.792557 2030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:01.792615 2031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:01.795176 2037 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:01.800177 2037 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:01.809330 2037 catalog_manager.cc:1347] Generated new cluster ID: f1d27b5fd5b84d7ea66ff3e522feabd7
I20260923 19:41:01.809477 2037 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:01.827189 2037 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:01.828557 2037 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:01.856113 2037 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73f5c76080e44a6fb8581fe5dee7b470: Generated new TSK 0
I20260923 19:41:01.857120 2037 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:01.875902 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1952
W20260923 19:41:01.877177 2014 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.63:55927
W20260923 19:41:01.878016 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 1952: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:01.878175 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 1952
W20260923 19:41:01.896315 1937 connection.cc:535] client connection to 127.0.0.1:39937 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39937): Connection reset by peer (error 104)
2026-09-23T19:41:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1958 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:01 dist-test-slave-lzv7 krb5kdc[2050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:01 dist-test-slave-lzv7 krb5kdc[2050](info): set up 2 sockets
Sep 23 19:41:01 dist-test-slave-lzv7 krb5kdc[2050](info): commencing operation
krb5kdc: starting...
W20260923 19:41:03.006305 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:03 dist-test-slave-lzv7 krb5kdc[2050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:41:03.265509 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46223
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:03.602710 2063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:03.603046 2063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:03.603228 2063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:03.610594 2063 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:03.610743 2063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:03.610855 2063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:03.610961 2063 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:03.611042 2063 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:03.621337 2063 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46223
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:03.622731 2063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:03.624095 2063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:03.635943 2068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:03.636018 2069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:03.636034 2071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:03.636931 2063 server_base.cc:1034] running on GCE node
I20260923 19:41:03.637696 2063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:03.639178 2063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:03.640391 2063 hybrid_clock.cc:648] HybridClock initialized: now 1790192463640351 us; error 27 us; skew 500 ppm
I20260923 19:41:03.640702 2063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:03 dist-test-slave-lzv7 krb5kdc[2050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192463, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:03.643730 2063 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:41:03.645720 2063 webserver.cc:460] Webserver started at http://127.0.0.1:44405/ using document root <none> and password file <none>
I20260923 19:41:03.646453 2063 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:03.646605 2063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:03.646931 2063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:03.649983 2063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "456715ce8404495185eead292f69149f"
format_stamp: "Formatted at 2026-09-23 19:41:03 on dist-test-slave-lzv7"
server_key: "386a2956f350f606bf77302fdb02d16f"
server_key_iv: "f94239915a5d79015ac83cc9166f893e"
server_key_version: "encryptionkey@0"
I20260923 19:41:03.650754 2063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "456715ce8404495185eead292f69149f"
format_stamp: "Formatted at 2026-09-23 19:41:03 on dist-test-slave-lzv7"
server_key: "386a2956f350f606bf77302fdb02d16f"
server_key_iv: "f94239915a5d79015ac83cc9166f893e"
server_key_version: "encryptionkey@0"
I20260923 19:41:03.656177 2063 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260923 19:41:03.659731 2078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:03.661084 2063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:03.661274 2063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "456715ce8404495185eead292f69149f"
format_stamp: "Formatted at 2026-09-23 19:41:03 on dist-test-slave-lzv7"
server_key: "386a2956f350f606bf77302fdb02d16f"
server_key_iv: "f94239915a5d79015ac83cc9166f893e"
server_key_version: "encryptionkey@0"
I20260923 19:41:03.661494 2063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:03.667766 2063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:03.672171 2063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:03.672490 2063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:03.691214 2063 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46223
I20260923 19:41:03.691252 2129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46223 every 8 connection(s)
I20260923 19:41:03.692708 2063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:03.697131 2130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:03.699735 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2063
I20260923 19:41:03.699921 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:03.700342 12927 external_mini_cluster.cc:1428] Setting key 1240037cd97adc2c955d1a05f128fb45
I20260923 19:41:03.709488 2133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:03.702326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:38187 (local address 127.0.0.1:46223)
0923 19:41:03.703158 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:03.703174 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:03.703227 (+ 53us) server_negotiation.cc:407] Connection header received
0923 19:41:03.705499 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:03.705528 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:03.706056 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:03.706523 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:03.707523 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:03.707532 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:03.707549 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:03.707570 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:03.707641 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:03.707669 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:03.707901 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:03.708039 (+ 138us) server_negotiation.cc:299] Negotiation successful
0923 19:41:03.708243 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":352,"threads_started":1}
I20260923 19:41:03.711019 2130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f: Bootstrap starting.
I20260923 19:41:03.713321 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:03.714434 2130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:03.715461 2130 log.cc:824] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:03.718442 2130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f: No bootstrap required, opened a new log
I20260923 19:41:03.720526 2133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:03.717745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.63:57665 (local address 127.0.0.1:46223)
0923 19:41:03.718007 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:03.718016 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:03.718418 (+ 402us) server_negotiation.cc:407] Connection header received
0923 19:41:03.718675 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:03.718679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:03.718731 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:03.718820 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:03.719839 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:03.719845 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:03.719849 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:03.719863 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:03.719902 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:03.719917 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:03.720004 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:03.720153 (+ 149us) server_negotiation.cc:299] Negotiation successful
0923 19:41:03.720200 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260923 19:41:03.727002 2130 raft_consensus.cc:348] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456715ce8404495185eead292f69149f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46223 } }
I20260923 19:41:03.727404 2130 raft_consensus.cc:374] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:03.727502 2130 raft_consensus.cc:729] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 456715ce8404495185eead292f69149f, State: Initialized, Role: FOLLOWER
I20260923 19:41:03.728086 2130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456715ce8404495185eead292f69149f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46223 } }
I20260923 19:41:03.728302 2130 raft_consensus.cc:388] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:03.728406 2130 raft_consensus.cc:482] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:03.728592 2130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:03.731263 2130 raft_consensus.cc:504] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456715ce8404495185eead292f69149f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46223 } }
I20260923 19:41:03.731721 2130 leader_election.cc:302] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 456715ce8404495185eead292f69149f; no voters:
I20260923 19:41:03.732264 2130 leader_election.cc:288] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:03.732412 2140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:03.733127 2140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [term 1 LEADER]: Becoming Leader. State: Replica: 456715ce8404495185eead292f69149f, State: Running, Role: LEADER
I20260923 19:41:03.733642 2140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456715ce8404495185eead292f69149f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46223 } }
I20260923 19:41:03.734441 2130 sys_catalog.cc:564] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:03.736723 2142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 456715ce8404495185eead292f69149f. Latest consensus state: current_term: 1 leader_uuid: "456715ce8404495185eead292f69149f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456715ce8404495185eead292f69149f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46223 } } }
I20260923 19:41:03.737076 2142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:03.736825 2141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "456715ce8404495185eead292f69149f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456715ce8404495185eead292f69149f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46223 } } }
I20260923 19:41:03.737275 2141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:03.738332 2146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:03.745446 2146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:03.754335 2146 catalog_manager.cc:1347] Generated new cluster ID: a38fdcab7afc47b48d51971e7adc8404
I20260923 19:41:03.754477 2146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:03.770857 2146 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:03.771384 2146 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:03.789886 2146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 456715ce8404495185eead292f69149f: Generated new TSK 0
I20260923 19:41:03.791002 2146 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:03.796514 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2063
W20260923 19:41:03.797725 2125 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.63:38187
W20260923 19:41:03.798540 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2063: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:03.798756 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2063
2026-09-23T19:41:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1915 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:03 dist-test-slave-lzv7 krb5kdc[2161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:03 dist-test-slave-lzv7 krb5kdc[2161](info): set up 2 sockets
Sep 23 19:41:03 dist-test-slave-lzv7 krb5kdc[2161](info): commencing operation
krb5kdc: starting...
W20260923 19:41:04.942214 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:05 dist-test-slave-lzv7 krb5kdc[2161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:05.199200 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33457
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:05.530268 2174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:05.530660 2174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:05.530820 2174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:05.538125 2174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:05.538280 2174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:05.538388 2174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:05.538497 2174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:05.538585 2174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:05.548657 2174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33457
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:05.550087 2174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:05.551395 2174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:05.562873 2179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:05.562924 2182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:05.563051 2180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:05.563936 2174 server_base.cc:1034] running on GCE node
I20260923 19:41:05.564741 2174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:05.566169 2174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:05.567389 2174 hybrid_clock.cc:648] HybridClock initialized: now 1790192465567347 us; error 43 us; skew 500 ppm
I20260923 19:41:05.567696 2174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:05 dist-test-slave-lzv7 krb5kdc[2161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192465, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:05.570690 2174 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:05.572099 2174 webserver.cc:460] Webserver started at http://127.12.159.254:36627/ using document root <none> and password file <none>
I20260923 19:41:05.572762 2174 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:05.572867 2174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:05.573115 2174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:05.576146 2174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "0e3dbf73f79b43b0aa3e4248a475664d"
format_stamp: "Formatted at 2026-09-23 19:41:05 on dist-test-slave-lzv7"
server_key: "505710706cac4dce5f7692400ee80ed7"
server_key_iv: "f52921d04734d65d9caee6ecbf20386a"
server_key_version: "encryptionkey@0"
I20260923 19:41:05.576933 2174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "0e3dbf73f79b43b0aa3e4248a475664d"
format_stamp: "Formatted at 2026-09-23 19:41:05 on dist-test-slave-lzv7"
server_key: "505710706cac4dce5f7692400ee80ed7"
server_key_iv: "f52921d04734d65d9caee6ecbf20386a"
server_key_version: "encryptionkey@0"
I20260923 19:41:05.582218 2174 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:41:05.585546 2189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:05.586899 2174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:41:05.587087 2174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "0e3dbf73f79b43b0aa3e4248a475664d"
format_stamp: "Formatted at 2026-09-23 19:41:05 on dist-test-slave-lzv7"
server_key: "505710706cac4dce5f7692400ee80ed7"
server_key_iv: "f52921d04734d65d9caee6ecbf20386a"
server_key_version: "encryptionkey@0"
I20260923 19:41:05.587258 2174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:05.615257 2174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:05.619280 2174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:05.619594 2174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:05.638080 2174 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:33457
I20260923 19:41:05.638085 2240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:33457 every 8 connection(s)
I20260923 19:41:05.639441 2174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:05.643076 2241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:05.644585 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2174
I20260923 19:41:05.644765 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:05.645202 12927 external_mini_cluster.cc:1428] Setting key 7a7d3a5a468667e4755cb86a24c224fd
I20260923 19:41:05.657301 2241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d: Bootstrap starting.
Sep 23 19:41:05 dist-test-slave-lzv7 krb5kdc[2161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:41:05.660378 2241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:05.661450 2241 log.cc:824] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:05.664237 2241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d: No bootstrap required, opened a new log
I20260923 19:41:05.668149 2244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:05.647109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39625 (local address 127.12.159.254:33457)
0923 19:41:05.647941 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:05.647960 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:05.648013 (+ 53us) server_negotiation.cc:407] Connection header received
0923 19:41:05.649705 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:05.649734 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:05.650275 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:05.650718 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:05.652077 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:05.654103 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:05.655397 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:05.656423 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:05.656603 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:05.660688 (+ 4085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:05.660696 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:05.660713 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:05.660752 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:05.663891 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:05.664755 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:05.664761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:05.664767 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:05.664937 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:05.665382 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:05.665387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:05.665397 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:05.665985 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:05.666323 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:05.666857 (+ 534us) server_negotiation.cc:299] Negotiation successful
0923 19:41:05.667170 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":371,"threads_started":1}
I20260923 19:41:05.672035 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:05.672338 2241 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33457 } }
I20260923 19:41:05.672688 2241 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:05.672791 2241 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e3dbf73f79b43b0aa3e4248a475664d, State: Initialized, Role: FOLLOWER
I20260923 19:41:05.673313 2241 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33457 } }
I20260923 19:41:05.673555 2241 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:05.673698 2241 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:05.673904 2241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:05.676193 2241 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33457 } }
I20260923 19:41:05.676745 2241 leader_election.cc:302] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e3dbf73f79b43b0aa3e4248a475664d; no voters:
I20260923 19:41:05.677446 2241 leader_election.cc:288] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:05.677574 2251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:05.678776 2251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [term 1 LEADER]: Becoming Leader. State: Replica: 0e3dbf73f79b43b0aa3e4248a475664d, State: Running, Role: LEADER
I20260923 19:41:05.679450 2251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33457 } }
I20260923 19:41:05.679941 2241 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:05.683554 2252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33457 } } }
I20260923 19:41:05.683943 2252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:05.684409 2253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e3dbf73f79b43b0aa3e4248a475664d. Latest consensus state: current_term: 1 leader_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3dbf73f79b43b0aa3e4248a475664d" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33457 } } }
I20260923 19:41:05.684666 2253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:05.693934 2259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:05.698320 2244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:05.676742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35481 (local address 127.12.159.254:33457)
0923 19:41:05.676976 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:05.676985 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:05.677454 (+ 469us) server_negotiation.cc:407] Connection header received
0923 19:41:05.677681 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:05.677688 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:05.677771 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:05.677924 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:05.680136 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:05.681479 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:05.683581 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:05.684332 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:05.684472 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:05.688553 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:05.688563 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:05.688571 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:05.688624 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:05.693723 (+ 5099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:05.694852 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:05.694857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:05.694861 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:05.695002 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:05.695647 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:05.695652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:05.695656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:05.696254 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:05.697532 (+ 1278us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:05.697724 (+ 192us) server_negotiation.cc:299] Negotiation successful
0923 19:41:05.697938 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260923 19:41:05.699610 2259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:05.709517 2259 catalog_manager.cc:1347] Generated new cluster ID: f74e0b6b897b4747841ccf331ba382fb
I20260923 19:41:05.709728 2259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:05.736661 2259 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:05.738193 2259 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:05.749955 2259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e3dbf73f79b43b0aa3e4248a475664d: Generated new TSK 0
I20260923 19:41:05.750896 2259 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:05.756263 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2174
I20260923 19:41:05.757665 2236 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:05.851148 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2174
W20260923 19:41:05.868502 2159 connection.cc:535] client connection to 127.12.159.254:33457 recv error: Network error: failed to read from TLS socket (remote: 127.12.159.254:33457): Connection reset by peer (error 104)
2026-09-23T19:41:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2051 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:05 dist-test-slave-lzv7 krb5kdc[2273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:05 dist-test-slave-lzv7 krb5kdc[2273](info): set up 2 sockets
Sep 23 19:41:05 dist-test-slave-lzv7 krb5kdc[2273](info): commencing operation
krb5kdc: starting...
W20260923 19:41:06.962387 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:07 dist-test-slave-lzv7 krb5kdc[2273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:07.229111 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:43119
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:43119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:07.562755 2286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:07.563074 2286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:07.563263 2286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:07.570685 2286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:07.570832 2286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:07.570969 2286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:07.571108 2286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:07.571189 2286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:07.581419 2286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:43119
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:43119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:07.582847 2286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:07.584239 2286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:07.596999 2291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:07.597107 2292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:07.597851 2294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:07.598647 2286 server_base.cc:1034] running on GCE node
I20260923 19:41:07.599931 2286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:07.601527 2286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:07.602859 2286 hybrid_clock.cc:648] HybridClock initialized: now 1790192467602663 us; error 82 us; skew 500 ppm
I20260923 19:41:07.603544 2286 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:07 dist-test-slave-lzv7 krb5kdc[2273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192467, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:07.607856 2286 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:07.611588 2286 webserver.cc:460] Webserver started at http://127.12.159.254:37799/ using document root <none> and password file <none>
I20260923 19:41:07.612608 2286 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:07.612758 2286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:07.613147 2286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:07.617949 2286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "f261ef912c2a4dbfb4b53c3810256fca"
format_stamp: "Formatted at 2026-09-23 19:41:07 on dist-test-slave-lzv7"
server_key: "38bf242245154306613b7e5124149f6e"
server_key_iv: "33f88ab3752e05997d0ad565e272d269"
server_key_version: "encryptionkey@0"
I20260923 19:41:07.619132 2286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "f261ef912c2a4dbfb4b53c3810256fca"
format_stamp: "Formatted at 2026-09-23 19:41:07 on dist-test-slave-lzv7"
server_key: "38bf242245154306613b7e5124149f6e"
server_key_iv: "33f88ab3752e05997d0ad565e272d269"
server_key_version: "encryptionkey@0"
I20260923 19:41:07.627157 2286 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260923 19:41:07.632316 2301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:07.634400 2286 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260923 19:41:07.634680 2286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "f261ef912c2a4dbfb4b53c3810256fca"
format_stamp: "Formatted at 2026-09-23 19:41:07 on dist-test-slave-lzv7"
server_key: "38bf242245154306613b7e5124149f6e"
server_key_iv: "33f88ab3752e05997d0ad565e272d269"
server_key_version: "encryptionkey@0"
I20260923 19:41:07.634999 2286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:07.659330 2286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:07.663877 2286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:07.664158 2286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:07.684052 2286 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:43119
I20260923 19:41:07.684054 2352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:43119 every 8 connection(s)
I20260923 19:41:07.685654 2286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:07.689548 2353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:07.694765 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2286
I20260923 19:41:07.694969 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:07.695521 12927 external_mini_cluster.cc:1428] Setting key 12950e086f3f692c4b11547b0e3eb544
I20260923 19:41:07.701552 2353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca: Bootstrap starting.
I20260923 19:41:07.704913 2353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:07.706105 2353 log.cc:824] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:07.709769 2353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca: No bootstrap required, opened a new log
I20260923 19:41:07.710058 2356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:07.697469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35583 (local address 127.12.159.254:43119)
0923 19:41:07.698376 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:07.698392 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:07.698440 (+ 48us) server_negotiation.cc:407] Connection header received
0923 19:41:07.700330 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:07.700356 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:07.700804 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:07.701236 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:07.701892 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:07.703226 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:07.704588 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:07.705617 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:07.705873 (+ 256us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:07.707227 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:07.707234 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:07.707249 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:07.707943 (+ 694us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:07.708040 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:07.708071 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:07.708236 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:07.708517 (+ 281us) server_negotiation.cc:299] Negotiation successful
0923 19:41:07.708705 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":453,"threads_started":1}
I20260923 19:41:07.714079 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:07.719916 2353 raft_consensus.cc:348] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f261ef912c2a4dbfb4b53c3810256fca" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 43119 } }
I20260923 19:41:07.720371 2353 raft_consensus.cc:374] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:07.720512 2353 raft_consensus.cc:729] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f261ef912c2a4dbfb4b53c3810256fca, State: Initialized, Role: FOLLOWER
I20260923 19:41:07.721199 2353 consensus_queue.cc:260] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f261ef912c2a4dbfb4b53c3810256fca" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 43119 } }
I20260923 19:41:07.721484 2353 raft_consensus.cc:388] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:07.721666 2353 raft_consensus.cc:482] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:07.721894 2353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:07.724222 2353 raft_consensus.cc:504] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f261ef912c2a4dbfb4b53c3810256fca" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 43119 } }
I20260923 19:41:07.724918 2353 leader_election.cc:302] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f261ef912c2a4dbfb4b53c3810256fca; no voters:
I20260923 19:41:07.725646 2353 leader_election.cc:288] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:07.725871 2363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:07.727393 2356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:07.719695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45271 (local address 127.12.159.254:43119)
0923 19:41:07.719891 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:07.719902 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:07.720443 (+ 541us) server_negotiation.cc:407] Connection header received
0923 19:41:07.720709 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:07.720715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:07.720803 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:07.720921 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:07.721487 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:07.722488 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:07.723875 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:07.724368 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:07.724531 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:07.725887 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:07.725896 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:07.725903 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:07.725929 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:07.726007 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:07.726032 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:07.726725 (+ 693us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:07.726829 (+ 104us) server_negotiation.cc:299] Negotiation successful
0923 19:41:07.726902 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:41:07.727957 2353 sys_catalog.cc:564] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:07.730526 2363 raft_consensus.cc:686] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [term 1 LEADER]: Becoming Leader. State: Replica: f261ef912c2a4dbfb4b53c3810256fca, State: Running, Role: LEADER
I20260923 19:41:07.731101 2363 consensus_queue.cc:237] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f261ef912c2a4dbfb4b53c3810256fca" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 43119 } }
I20260923 19:41:07.733713 2365 sys_catalog.cc:455] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [sys.catalog]: SysCatalogTable state changed. Reason: New leader f261ef912c2a4dbfb4b53c3810256fca. Latest consensus state: current_term: 1 leader_uuid: "f261ef912c2a4dbfb4b53c3810256fca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f261ef912c2a4dbfb4b53c3810256fca" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 43119 } } }
I20260923 19:41:07.733973 2364 sys_catalog.cc:455] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f261ef912c2a4dbfb4b53c3810256fca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f261ef912c2a4dbfb4b53c3810256fca" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 43119 } } }
I20260923 19:41:07.734458 2365 sys_catalog.cc:458] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:07.734524 2364 sys_catalog.cc:458] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:07.735476 2370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:07.746013 2370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:07.754978 2370 catalog_manager.cc:1347] Generated new cluster ID: dc9e0d3832284c4eb5ef89a0b08ebd60
I20260923 19:41:07.755108 2370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:07.778170 2370 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:07.780097 2370 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:07.797156 2370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f261ef912c2a4dbfb4b53c3810256fca: Generated new TSK 0
I20260923 19:41:07.798269 2370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:07.809453 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2286
W20260923 19:41:07.810715 2348 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35583
W20260923 19:41:07.811499 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2286: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:07.811659 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2286
W20260923 19:41:07.829385 2271 connection.cc:535] client connection to 127.12.159.254:43119 recv error: Network error: failed to read from TLS socket (remote: 127.12.159.254:43119): Connection reset by peer (error 104)
2026-09-23T19:41:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1961 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:07 dist-test-slave-lzv7 krb5kdc[2384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:07 dist-test-slave-lzv7 krb5kdc[2384](info): set up 2 sockets
Sep 23 19:41:07 dist-test-slave-lzv7 krb5kdc[2384](info): commencing operation
krb5kdc: starting...
W20260923 19:41:08.915066 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:09 dist-test-slave-lzv7 krb5kdc[2384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:09.182135 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:36925
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:40755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:36925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:09.515671 2397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:09.516116 2397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:09.516364 2397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:09.524024 2397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:09.524130 2397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:09.524178 2397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:09.524238 2397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:09.524282 2397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:09.533955 2397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:40755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:36925
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:36925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:09.535158 2397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:09.536435 2397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:09.548791 2402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:09.548882 2403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:09.548895 2405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:09.549701 2397 server_base.cc:1034] running on GCE node
I20260923 19:41:09.550503 2397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:09.552337 2397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:09.553596 2397 hybrid_clock.cc:648] HybridClock initialized: now 1790192469553548 us; error 36 us; skew 500 ppm
I20260923 19:41:09.554061 2397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:09 dist-test-slave-lzv7 krb5kdc[2384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192469, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:09.557900 2397 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:09.561844 2397 webserver.cc:460] Webserver started at http://127.12.159.254:45047/ using document root <none> and password file <none>
I20260923 19:41:09.562574 2397 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:09.562716 2397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:09.563051 2397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:09.566411 2397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "896f80f2ab8a4b3fa36deb9656e0a802"
format_stamp: "Formatted at 2026-09-23 19:41:09 on dist-test-slave-lzv7"
server_key: "29cea45f8c69898c048bf44f4475d1c4"
server_key_iv: "366bfdda9ca4250d9311bcf5e74ee54b"
server_key_version: "encryptionkey@0"
I20260923 19:41:09.567370 2397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "896f80f2ab8a4b3fa36deb9656e0a802"
format_stamp: "Formatted at 2026-09-23 19:41:09 on dist-test-slave-lzv7"
server_key: "29cea45f8c69898c048bf44f4475d1c4"
server_key_iv: "366bfdda9ca4250d9311bcf5e74ee54b"
server_key_version: "encryptionkey@0"
I20260923 19:41:09.572718 2397 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:41:09.576491 2412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:09.577984 2397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:41:09.578202 2397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "896f80f2ab8a4b3fa36deb9656e0a802"
format_stamp: "Formatted at 2026-09-23 19:41:09 on dist-test-slave-lzv7"
server_key: "29cea45f8c69898c048bf44f4475d1c4"
server_key_iv: "366bfdda9ca4250d9311bcf5e74ee54b"
server_key_version: "encryptionkey@0"
I20260923 19:41:09.578445 2397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:09.584678 2397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:09.589090 2397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:09.589416 2397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:09.607770 2397 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:36925
I20260923 19:41:09.607801 2463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:36925 every 8 connection(s)
I20260923 19:41:09.609215 2397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:09.612999 2464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:09.616643 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2397
I20260923 19:41:09.616840 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:09.617261 12927 external_mini_cluster.cc:1428] Setting key 03e48e75a643a3a62ea1de656e5ffbee
I20260923 19:41:09.625036 2467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:09.619114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59311 (local address 127.12.159.254:36925)
0923 19:41:09.619946 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:09.619957 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:09.619998 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:41:09.621565 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:09.621589 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:09.622042 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:09.622406 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:09.623498 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:09.623504 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:09.623516 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:09.623540 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:09.623598 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:09.623618 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:09.623803 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:09.623899 (+ 96us) server_negotiation.cc:299] Negotiation successful
0923 19:41:09.624115 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":373,"threads_started":1}
I20260923 19:41:09.625864 2464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802: Bootstrap starting.
I20260923 19:41:09.629017 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:09.629613 2464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:09.630687 2464 log.cc:824] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:09.634055 2464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802: No bootstrap required, opened a new log
I20260923 19:41:09.636142 2467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:09.633644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46939 (local address 127.12.159.254:36925)
0923 19:41:09.633876 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:09.633883 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:09.634247 (+ 364us) server_negotiation.cc:407] Connection header received
0923 19:41:09.634420 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:09.634425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:09.634480 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:09.634600 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:09.635456 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:09.635461 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:09.635467 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:09.635485 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:09.635530 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:09.635549 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:09.635666 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:09.635741 (+ 75us) server_negotiation.cc:299] Negotiation successful
0923 19:41:09.635797 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 19:41:09.642758 2464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36925 } }
I20260923 19:41:09.643173 2464 raft_consensus.cc:374] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:09.643292 2464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896f80f2ab8a4b3fa36deb9656e0a802, State: Initialized, Role: FOLLOWER
I20260923 19:41:09.643934 2464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36925 } }
I20260923 19:41:09.644172 2464 raft_consensus.cc:388] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:09.644327 2464 raft_consensus.cc:482] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:09.644515 2464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:09.646816 2464 raft_consensus.cc:504] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36925 } }
I20260923 19:41:09.647337 2464 leader_election.cc:302] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 896f80f2ab8a4b3fa36deb9656e0a802; no voters:
I20260923 19:41:09.648088 2464 leader_election.cc:288] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:09.648221 2474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:09.648962 2474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [term 1 LEADER]: Becoming Leader. State: Replica: 896f80f2ab8a4b3fa36deb9656e0a802, State: Running, Role: LEADER
I20260923 19:41:09.649485 2474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36925 } }
I20260923 19:41:09.650300 2464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:09.652462 2475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36925 } } }
I20260923 19:41:09.652856 2475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:09.653426 2476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 896f80f2ab8a4b3fa36deb9656e0a802. Latest consensus state: current_term: 1 leader_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896f80f2ab8a4b3fa36deb9656e0a802" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 36925 } } }
I20260923 19:41:09.653692 2476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:09.653757 2482 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:09.662804 2482 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:09.671490 2482 catalog_manager.cc:1347] Generated new cluster ID: da162bcf65414eaab4a7cd9ab1044397
I20260923 19:41:09.671633 2482 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:09.735140 2482 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:09.735687 2482 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:09.749403 2482 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 896f80f2ab8a4b3fa36deb9656e0a802: Generated new TSK 0
I20260923 19:41:09.750530 2482 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:09.755959 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2397
W20260923 19:41:09.757156 2459 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59311
W20260923 19:41:09.757979 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2397: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:09.758158 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2397
2026-09-23T19:41:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1945 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:09 dist-test-slave-lzv7 krb5kdc[2495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:09 dist-test-slave-lzv7 krb5kdc[2495](info): set up 2 sockets
Sep 23 19:41:09 dist-test-slave-lzv7 krb5kdc[2495](info): commencing operation
krb5kdc: starting...
W20260923 19:41:10.878770 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.001s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:11 dist-test-slave-lzv7 krb5kdc[2495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:11.145093 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:46233
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:46233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:11.471263 2508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:11.471622 2508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:11.471813 2508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:11.478961 2508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:11.479125 2508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:11.479246 2508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:11.479358 2508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:11.479458 2508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:11.489045 2508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:46233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:46233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:11.490417 2508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:11.491717 2508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:11.503664 2516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:11.503634 2514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:11.503711 2513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:11.504797 2508 server_base.cc:1034] running on GCE node
I20260923 19:41:11.505558 2508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:11.507042 2508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:11.508272 2508 hybrid_clock.cc:648] HybridClock initialized: now 1790192471508232 us; error 64 us; skew 500 ppm
I20260923 19:41:11.508633 2508 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:11 dist-test-slave-lzv7 krb5kdc[2495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:11.511750 2508 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:11.513258 2508 webserver.cc:460] Webserver started at http://127.12.159.254:40625/ using document root <none> and password file <none>
I20260923 19:41:11.514016 2508 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:11.514163 2508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:11.514461 2508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:11.517372 2508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "be7f4b3769b2494cb481689641a05438"
format_stamp: "Formatted at 2026-09-23 19:41:11 on dist-test-slave-lzv7"
server_key: "fdeca7c7e4bbca495c6b7074ba686219"
server_key_iv: "c886c990df25ae272469c93a3e94070f"
server_key_version: "encryptionkey@0"
I20260923 19:41:11.518168 2508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "be7f4b3769b2494cb481689641a05438"
format_stamp: "Formatted at 2026-09-23 19:41:11 on dist-test-slave-lzv7"
server_key: "fdeca7c7e4bbca495c6b7074ba686219"
server_key_iv: "c886c990df25ae272469c93a3e94070f"
server_key_version: "encryptionkey@0"
I20260923 19:41:11.523276 2508 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:41:11.526692 2523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:11.527994 2508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:41:11.528179 2508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "be7f4b3769b2494cb481689641a05438"
format_stamp: "Formatted at 2026-09-23 19:41:11 on dist-test-slave-lzv7"
server_key: "fdeca7c7e4bbca495c6b7074ba686219"
server_key_iv: "c886c990df25ae272469c93a3e94070f"
server_key_version: "encryptionkey@0"
I20260923 19:41:11.528375 2508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:11.542583 2508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:11.547029 2508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:11.547314 2508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:11.566092 2508 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:46233
I20260923 19:41:11.566110 2574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:46233 every 8 connection(s)
I20260923 19:41:11.567517 2508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:11.569746 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2508
I20260923 19:41:11.569967 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:11.570394 12927 external_mini_cluster.cc:1428] Setting key d7c68dedce91e06376415a5e90424833
I20260923 19:41:11.571426 2575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:41:11 dist-test-slave-lzv7 krb5kdc[2495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:41:11.585283 2575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438: Bootstrap starting.
I20260923 19:41:11.589493 2575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:11.590801 2575 log.cc:824] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:11.594139 2575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438: No bootstrap required, opened a new log
I20260923 19:41:11.594337 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:11.572124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47613 (local address 127.12.159.254:46233)
0923 19:41:11.572880 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:11.572894 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:11.572944 (+ 50us) server_negotiation.cc:407] Connection header received
0923 19:41:11.574865 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:11.574893 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:11.575426 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:11.575864 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:11.577150 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:11.579237 (+ 2087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:11.580474 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:11.581540 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:11.581731 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:11.585944 (+ 4213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:11.585954 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:11.585972 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:11.586023 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:11.589966 (+ 3943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:11.590680 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:11.590688 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:11.590696 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:11.590914 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:11.591328 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:11.591336 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:11.591341 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:11.591931 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:11.592229 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:11.592589 (+ 360us) server_negotiation.cc:299] Negotiation successful
0923 19:41:11.593009 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":315,"threads_started":1}
I20260923 19:41:11.598219 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:11.604632 2575 raft_consensus.cc:348] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7f4b3769b2494cb481689641a05438" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46233 } }
I20260923 19:41:11.605038 2575 raft_consensus.cc:374] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:11.605165 2575 raft_consensus.cc:729] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be7f4b3769b2494cb481689641a05438, State: Initialized, Role: FOLLOWER
I20260923 19:41:11.605743 2575 consensus_queue.cc:260] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7f4b3769b2494cb481689641a05438" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46233 } }
I20260923 19:41:11.606082 2575 raft_consensus.cc:388] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:11.606266 2575 raft_consensus.cc:482] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:11.606463 2575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:11.608717 2575 raft_consensus.cc:504] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7f4b3769b2494cb481689641a05438" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46233 } }
I20260923 19:41:11.609251 2575 leader_election.cc:302] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be7f4b3769b2494cb481689641a05438; no voters:
I20260923 19:41:11.609953 2575 leader_election.cc:288] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:11.610069 2585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:11.612218 2575 sys_catalog.cc:564] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:11.616705 2585 raft_consensus.cc:686] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [term 1 LEADER]: Becoming Leader. State: Replica: be7f4b3769b2494cb481689641a05438, State: Running, Role: LEADER
I20260923 19:41:11.617331 2585 consensus_queue.cc:237] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7f4b3769b2494cb481689641a05438" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46233 } }
I20260923 19:41:11.620249 2586 sys_catalog.cc:455] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be7f4b3769b2494cb481689641a05438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7f4b3769b2494cb481689641a05438" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46233 } } }
I20260923 19:41:11.620659 2586 sys_catalog.cc:458] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:11.621142 2587 sys_catalog.cc:455] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be7f4b3769b2494cb481689641a05438. Latest consensus state: current_term: 1 leader_uuid: "be7f4b3769b2494cb481689641a05438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7f4b3769b2494cb481689641a05438" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 46233 } } }
I20260923 19:41:11.621429 2587 sys_catalog.cc:458] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:11.621886 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:11.603490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40729 (local address 127.12.159.254:46233)
0923 19:41:11.603692 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:11.603698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:11.604205 (+ 507us) server_negotiation.cc:407] Connection header received
0923 19:41:11.604319 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:11.604325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:11.604403 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:11.604514 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:11.606152 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:11.607083 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:11.608313 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:11.608763 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:11.608909 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:11.612073 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:11.612083 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:11.612091 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:11.612144 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:11.617002 (+ 4858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:11.618023 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:11.618028 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:11.618032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:11.618253 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:11.618709 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:11.618713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:11.618716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:11.619195 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:11.620820 (+ 1625us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:11.620979 (+ 159us) server_negotiation.cc:299] Negotiation successful
0923 19:41:11.621246 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:41:11.627130 2595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:11.632383 2595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:11.641027 2595 catalog_manager.cc:1347] Generated new cluster ID: 38a4e3b5269046b7bd5f70127af7ac59
I20260923 19:41:11.641145 2595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:11.656634 2595 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:11.658052 2595 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:11.667398 2595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be7f4b3769b2494cb481689641a05438: Generated new TSK 0
I20260923 19:41:11.668258 2595 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:11.681452 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2508
I20260923 19:41:11.682927 2570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:11.777654 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2508
2026-09-23T19:41:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2016 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:11 dist-test-slave-lzv7 krb5kdc[2607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:11 dist-test-slave-lzv7 krb5kdc[2607](info): set up 2 sockets
Sep 23 19:41:11 dist-test-slave-lzv7 krb5kdc[2607](info): commencing operation
krb5kdc: starting...
W20260923 19:41:12.894469 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:13 dist-test-slave-lzv7 krb5kdc[2607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:13.154758 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41507
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:36937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:41507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:13.488451 2620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:13.488816 2620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:13.489022 2620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:13.496433 2620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:13.496603 2620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:13.496701 2620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:13.496812 2620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:13.496887 2620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:13.507072 2620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:36937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:41507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:41507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:13.508414 2620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:13.509770 2620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:13.521613 2628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:13.521652 2625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:13.521566 2626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:13.522454 2620 server_base.cc:1034] running on GCE node
I20260923 19:41:13.523288 2620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:13.524662 2620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:13.525883 2620 hybrid_clock.cc:648] HybridClock initialized: now 1790192473525830 us; error 49 us; skew 500 ppm
I20260923 19:41:13.526226 2620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:13 dist-test-slave-lzv7 krb5kdc[2607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192473, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:13.534312 2620 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:13.535867 2620 webserver.cc:460] Webserver started at http://127.12.159.254:38241/ using document root <none> and password file <none>
I20260923 19:41:13.536532 2620 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:13.536638 2620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:13.536904 2620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:13.539968 2620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "04546abf1c1448f3baf5c31f624097c0"
format_stamp: "Formatted at 2026-09-23 19:41:13 on dist-test-slave-lzv7"
server_key: "dc6261ef9955a6e2d3fa4f90cb9d5f1f"
server_key_iv: "4ed23652ab358a2ebac38de49b9f4a6b"
server_key_version: "encryptionkey@0"
I20260923 19:41:13.540688 2620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "04546abf1c1448f3baf5c31f624097c0"
format_stamp: "Formatted at 2026-09-23 19:41:13 on dist-test-slave-lzv7"
server_key: "dc6261ef9955a6e2d3fa4f90cb9d5f1f"
server_key_iv: "4ed23652ab358a2ebac38de49b9f4a6b"
server_key_version: "encryptionkey@0"
I20260923 19:41:13.546298 2620 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:41:13.549785 2635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:13.551169 2620 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:13.551342 2620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "04546abf1c1448f3baf5c31f624097c0"
format_stamp: "Formatted at 2026-09-23 19:41:13 on dist-test-slave-lzv7"
server_key: "dc6261ef9955a6e2d3fa4f90cb9d5f1f"
server_key_iv: "4ed23652ab358a2ebac38de49b9f4a6b"
server_key_version: "encryptionkey@0"
I20260923 19:41:13.551534 2620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:13.574159 2620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:13.578293 2620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:13.578604 2620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:13.597342 2620 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:41507
I20260923 19:41:13.597366 2686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:41507 every 8 connection(s)
I20260923 19:41:13.598783 2620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:13.599828 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2620
I20260923 19:41:13.600054 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:13.600504 12927 external_mini_cluster.cc:1428] Setting key f6484bc5b37f8cc8f9d065bae1b77535
I20260923 19:41:13.603159 2687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:13.614283 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:13.602410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60589 (local address 127.12.159.254:41507)
0923 19:41:13.603268 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:13.603284 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:13.603330 (+ 46us) server_negotiation.cc:407] Connection header received
0923 19:41:13.604986 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:13.605007 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:13.605400 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:13.605735 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:13.606364 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:13.607703 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:13.609576 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:13.610307 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:13.610446 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:13.611794 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:13.611802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:13.611816 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:13.612409 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:13.612487 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:13.612512 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:13.612599 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:13.612856 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 19:41:13.613178 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":378,"threads_started":1}
I20260923 19:41:13.615661 2687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0: Bootstrap starting.
I20260923 19:41:13.617955 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:13.618978 2687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:13.619963 2687 log.cc:824] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:13.622937 2687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0: No bootstrap required, opened a new log
I20260923 19:41:13.629141 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:13.622469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60629 (local address 127.12.159.254:41507)
0923 19:41:13.622692 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:13.622698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:13.623060 (+ 362us) server_negotiation.cc:407] Connection header received
0923 19:41:13.623274 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:13.623278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:13.623335 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:13.623420 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:13.624099 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:13.624840 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:13.626708 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:13.627174 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:13.627269 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:13.628424 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:13.628429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:13.628432 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:13.628453 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:13.628489 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:13.628508 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:13.628579 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:13.628729 (+ 150us) server_negotiation.cc:299] Negotiation successful
0923 19:41:13.628806 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:41:13.632246 2687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04546abf1c1448f3baf5c31f624097c0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41507 } }
I20260923 19:41:13.632665 2687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:13.632767 2687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04546abf1c1448f3baf5c31f624097c0, State: Initialized, Role: FOLLOWER
I20260923 19:41:13.633322 2687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04546abf1c1448f3baf5c31f624097c0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41507 } }
I20260923 19:41:13.633553 2687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:13.633688 2687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:13.633888 2687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:13.636019 2687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04546abf1c1448f3baf5c31f624097c0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41507 } }
I20260923 19:41:13.636498 2687 leader_election.cc:302] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04546abf1c1448f3baf5c31f624097c0; no voters:
I20260923 19:41:13.637073 2687 leader_election.cc:288] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:13.637269 2697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:13.638305 2697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [term 1 LEADER]: Becoming Leader. State: Replica: 04546abf1c1448f3baf5c31f624097c0, State: Running, Role: LEADER
I20260923 19:41:13.638825 2697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04546abf1c1448f3baf5c31f624097c0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41507 } }
I20260923 19:41:13.639266 2687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:13.641844 2699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04546abf1c1448f3baf5c31f624097c0. Latest consensus state: current_term: 1 leader_uuid: "04546abf1c1448f3baf5c31f624097c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04546abf1c1448f3baf5c31f624097c0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41507 } } }
I20260923 19:41:13.642170 2699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:13.641515 2698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04546abf1c1448f3baf5c31f624097c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04546abf1c1448f3baf5c31f624097c0" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 41507 } } }
I20260923 19:41:13.642918 2698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:13.644593 2705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:13.649950 2705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:13.658427 2705 catalog_manager.cc:1347] Generated new cluster ID: 64b643df0ae64895b414f34b3d5a98c4
I20260923 19:41:13.658537 2705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:13.681339 2705 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:13.682879 2705 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:13.701347 2705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04546abf1c1448f3baf5c31f624097c0: Generated new TSK 0
I20260923 19:41:13.702347 2705 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:13.712637 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2620
W20260923 19:41:13.714026 2682 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60589
W20260923 19:41:13.714783 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2620: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:13.714938 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2620
2026-09-23T19:41:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1936 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:13 dist-test-slave-lzv7 krb5kdc[2718](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:13 dist-test-slave-lzv7 krb5kdc[2718](info): set up 2 sockets
Sep 23 19:41:13 dist-test-slave-lzv7 krb5kdc[2718](info): commencing operation
krb5kdc: starting...
W20260923 19:41:14.834403 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:15 dist-test-slave-lzv7 krb5kdc[2718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:15.108817 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45943
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:45943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:15.445451 2731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:15.445751 2731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:15.445966 2731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:15.453760 2731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:15.453892 2731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:15.453985 2731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:15.454097 2731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:15.454186 2731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:15.464308 2731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:45943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:45943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:15.465723 2731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:15.467151 2731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:15.479614 2737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:15.479647 2739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:15.479586 2736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:15.480527 2731 server_base.cc:1034] running on GCE node
I20260923 19:41:15.481345 2731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:15.482950 2731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:15.484205 2731 hybrid_clock.cc:648] HybridClock initialized: now 1790192475484148 us; error 48 us; skew 500 ppm
I20260923 19:41:15.484592 2731 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:15 dist-test-slave-lzv7 krb5kdc[2718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192475, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:15.488018 2731 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:15.489533 2731 webserver.cc:460] Webserver started at http://127.12.159.254:45957/ using document root <none> and password file <none>
I20260923 19:41:15.490317 2731 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:15.490470 2731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:15.490789 2731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:15.493853 2731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "dffb8b38b25842809b5330ea96208fcd"
format_stamp: "Formatted at 2026-09-23 19:41:15 on dist-test-slave-lzv7"
server_key: "0ff25006cdf2e8cb44e2166b6013b481"
server_key_iv: "df3e48b183bcaadd1c5fad8ea7f8dd7d"
server_key_version: "encryptionkey@0"
I20260923 19:41:15.494642 2731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "dffb8b38b25842809b5330ea96208fcd"
format_stamp: "Formatted at 2026-09-23 19:41:15 on dist-test-slave-lzv7"
server_key: "0ff25006cdf2e8cb44e2166b6013b481"
server_key_iv: "df3e48b183bcaadd1c5fad8ea7f8dd7d"
server_key_version: "encryptionkey@0"
I20260923 19:41:15.499943 2731 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260923 19:41:15.503545 2746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:15.504858 2731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:41:15.505041 2731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "dffb8b38b25842809b5330ea96208fcd"
format_stamp: "Formatted at 2026-09-23 19:41:15 on dist-test-slave-lzv7"
server_key: "0ff25006cdf2e8cb44e2166b6013b481"
server_key_iv: "df3e48b183bcaadd1c5fad8ea7f8dd7d"
server_key_version: "encryptionkey@0"
I20260923 19:41:15.505251 2731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:15.510962 2731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:15.515563 2731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:15.515872 2731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:15.534651 2731 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:45943
I20260923 19:41:15.534687 2797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:45943 every 8 connection(s)
I20260923 19:41:15.536024 2731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:15.539928 2798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:15.543856 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2731
I20260923 19:41:15.544039 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:15.544579 12927 external_mini_cluster.cc:1428] Setting key 25d87a2ce7d8c2e16ec83c414a399eab
I20260923 19:41:15.552409 2801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:15.546438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59877 (local address 127.12.159.254:45943)
0923 19:41:15.547267 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:15.547279 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:15.547321 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:41:15.548946 (+ 1625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:15.548968 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:15.549340 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:15.549664 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:15.550727 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:15.550733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:15.550745 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:15.550759 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:15.550817 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:15.550840 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:15.551012 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:15.551126 (+ 114us) server_negotiation.cc:299] Negotiation successful
0923 19:41:15.551348 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":363,"threads_started":1}
I20260923 19:41:15.553123 2798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd: Bootstrap starting.
I20260923 19:41:15.556142 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:15.556509 2798 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:15.557793 2798 log.cc:824] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:15.561570 2798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd: No bootstrap required, opened a new log
I20260923 19:41:15.564584 2801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:15.561771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48509 (local address 127.12.159.254:45943)
0923 19:41:15.562122 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:15.562135 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:15.562555 (+ 420us) server_negotiation.cc:407] Connection header received
0923 19:41:15.562751 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:15.562755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:15.562806 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:15.562885 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:15.563918 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:15.563925 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:15.563928 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:15.563943 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:15.563983 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:15.564001 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:15.564095 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:15.564213 (+ 118us) server_negotiation.cc:299] Negotiation successful
0923 19:41:15.564265 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260923 19:41:15.570659 2798 raft_consensus.cc:348] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffb8b38b25842809b5330ea96208fcd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45943 } }
I20260923 19:41:15.571090 2798 raft_consensus.cc:374] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:15.571211 2798 raft_consensus.cc:729] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffb8b38b25842809b5330ea96208fcd, State: Initialized, Role: FOLLOWER
I20260923 19:41:15.571826 2798 consensus_queue.cc:260] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffb8b38b25842809b5330ea96208fcd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45943 } }
I20260923 19:41:15.572085 2798 raft_consensus.cc:388] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:15.572232 2798 raft_consensus.cc:482] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:15.572424 2798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:15.574787 2798 raft_consensus.cc:504] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffb8b38b25842809b5330ea96208fcd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45943 } }
I20260923 19:41:15.575249 2798 leader_election.cc:302] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dffb8b38b25842809b5330ea96208fcd; no voters:
I20260923 19:41:15.575826 2798 leader_election.cc:288] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:15.575937 2808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:15.577167 2808 raft_consensus.cc:686] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [term 1 LEADER]: Becoming Leader. State: Replica: dffb8b38b25842809b5330ea96208fcd, State: Running, Role: LEADER
I20260923 19:41:15.577710 2808 consensus_queue.cc:237] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffb8b38b25842809b5330ea96208fcd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45943 } }
I20260923 19:41:15.578179 2798 sys_catalog.cc:564] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:15.580780 2810 sys_catalog.cc:455] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader dffb8b38b25842809b5330ea96208fcd. Latest consensus state: current_term: 1 leader_uuid: "dffb8b38b25842809b5330ea96208fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffb8b38b25842809b5330ea96208fcd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45943 } } }
I20260923 19:41:15.580842 2809 sys_catalog.cc:455] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dffb8b38b25842809b5330ea96208fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffb8b38b25842809b5330ea96208fcd" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 45943 } } }
I20260923 19:41:15.581178 2810 sys_catalog.cc:458] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:15.581221 2809 sys_catalog.cc:458] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:15.583103 2817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:15.588080 2817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:15.596865 2817 catalog_manager.cc:1347] Generated new cluster ID: d5564e0941994ea58edd7e9a2bd87c3b
I20260923 19:41:15.596999 2817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:15.625980 2817 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:15.626490 2817 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:15.635551 2817 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dffb8b38b25842809b5330ea96208fcd: Generated new TSK 0
I20260923 19:41:15.636613 2817 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:15.656675 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2731
W20260923 19:41:15.657848 2793 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59877
W20260923 19:41:15.658562 12927 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2731: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:15.658722 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2731
2026-09-23T19:41:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1946 ms)
[----------] 18 tests from AuthTokenIssuingTest (35570 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:15 dist-test-slave-lzv7 krb5kdc[2829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:15 dist-test-slave-lzv7 krb5kdc[2829](info): set up 2 sockets
Sep 23 19:41:15 dist-test-slave-lzv7 krb5kdc[2829](info): commencing operation
krb5kdc: starting...
W20260923 19:41:16.786480 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:16 dist-test-slave-lzv7 krb5kdc[2829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:17.061631 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:42529
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:42529,127.12.159.253:34395,127.12.159.252:34987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:17.401518 2842 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:41:17.401934 2842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:17.402019 2842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:17.402103 2842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:17.409278 2842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:17.409376 2842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:17.409435 2842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:17.409479 2842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:17.409534 2842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:17.419848 2842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:42529,127.12.159.253:34395,127.12.159.252:34987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:42529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:17.421113 2842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:17.422432 2842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:17.434593 2847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:17.434571 2848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:17.434654 2850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:17.435632 2842 server_base.cc:1034] running on GCE node
I20260923 19:41:17.436393 2842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:17.437873 2842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:17.439132 2842 hybrid_clock.cc:648] HybridClock initialized: now 1790192477439040 us; error 53 us; skew 500 ppm
I20260923 19:41:17.439440 2842 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:17 dist-test-slave-lzv7 krb5kdc[2829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:17.442742 2842 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:17.444162 2842 webserver.cc:460] Webserver started at http://127.12.159.254:36873/ using document root <none> and password file <none>
I20260923 19:41:17.444880 2842 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:17.444969 2842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:17.445235 2842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:17.448354 2842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f"
format_stamp: "Formatted at 2026-09-23 19:41:17 on dist-test-slave-lzv7"
server_key: "611f2c7977c4ce696827688fac2076e1"
server_key_iv: "ed0c899e739956bcc053d1a887f89b50"
server_key_version: "encryptionkey@0"
I20260923 19:41:17.449137 2842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f"
format_stamp: "Formatted at 2026-09-23 19:41:17 on dist-test-slave-lzv7"
server_key: "611f2c7977c4ce696827688fac2076e1"
server_key_iv: "ed0c899e739956bcc053d1a887f89b50"
server_key_version: "encryptionkey@0"
I20260923 19:41:17.455045 2842 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260923 19:41:17.459127 2857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:17.460660 2842 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:41:17.460829 2842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f"
format_stamp: "Formatted at 2026-09-23 19:41:17 on dist-test-slave-lzv7"
server_key: "611f2c7977c4ce696827688fac2076e1"
server_key_iv: "ed0c899e739956bcc053d1a887f89b50"
server_key_version: "encryptionkey@0"
I20260923 19:41:17.461032 2842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:17.477082 2842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:17.481686 2842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:17.481992 2842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:17.500976 2842 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:42529
I20260923 19:41:17.500999 2908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:42529 every 8 connection(s)
I20260923 19:41:17.502470 2842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:17.506420 2909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:17.507537 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2842
I20260923 19:41:17.507772 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:17.508399 12927 external_mini_cluster.cc:1428] Setting key 4b3506535deee443420d42a5860a5ccb
I20260923 19:41:17.513156 2909 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.159.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.253@KRBTEST.COM" created.
Sep 23 19:41:17 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:41:17.547272 2913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.516611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32986 (local address 127.12.159.254:42529)
0923 19:41:17.518571 (+ 1960us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:17.518580 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:17.518622 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:41:17.520889 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:17.520895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:17.521135 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:17.521324 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:17.523010 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:17.524202 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:17.526504 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:17.527043 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:17.527176 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:17.538498 (+ 11322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:17.538513 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:17.538535 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:17.538580 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:17.542615 (+ 4035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:17.543382 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:17.543394 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:17.543400 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:17.543613 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:17.544001 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:17.544010 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:17.544016 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:17.544797 (+ 781us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:17.544961 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:17.545730 (+ 769us) server_negotiation.cc:299] Negotiation successful
0923 19:41:17.546117 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1780,"spinlock_wait_cycles":22400,"thread_start_us":1541,"threads_started":1}
I20260923 19:41:17.547279 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.516611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:42529 (local address 127.0.0.1:32986)
0923 19:41:17.517576 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.517633 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:17.520508 (+ 2875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:17.521408 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:17.521418 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:17.522292 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:17.522798 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:17.522823 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:17.524391 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:17.524399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:17.526353 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:17.526370 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:17.527312 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:17.527324 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:17.527550 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:17.535605 (+ 8055us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:17.535633 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:17.538178 (+ 2545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:17.542776 (+ 4598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:17.542791 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:17.542802 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:17.543210 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:17.543724 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:17.543728 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:17.543730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:17.543881 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:17.544953 (+ 1072us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:17.544963 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:17.545285 (+ 322us) client_negotiation.cc:769] Sending connection context
0923 19:41:17.545612 (+ 327us) client_negotiation.cc:240] Negotiation successful
0923 19:41:17.546336 (+ 724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":94,"thread_start_us":383,"threads_started":1}
I20260923 19:41:17.550482 2909 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:41:17.551738 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.551202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56652)
0923 19:41:17.551420 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.551567 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260923 19:41:17.551977 2859 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
I20260923 19:41:17.553500 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.553171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56660)
0923 19:41:17.553308 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.553373 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260923 19:41:17.553869 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:34395: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab.
Entry for principal kudu/127.12.159.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab.
I20260923 19:41:17.572916 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:34395
--webserver_interface=127.12.159.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab
--principal=kudu/127.12.159.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:42529,127.12.159.253:34395,127.12.159.252:34987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:41:17.603214 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } attempt: 1
I20260923 19:41:17.604472 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.604004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56672)
0923 19:41:17.604199 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.604338 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260923 19:41:17.605458 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.605110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56678)
0923 19:41:17.605267 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.605333 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260923 19:41:17.605623 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:34395: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
I20260923 19:41:17.673864 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } attempt: 2
I20260923 19:41:17.675120 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.674634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56684)
0923 19:41:17.674897 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.674983 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 19:41:17.676326 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.675819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56700)
0923 19:41:17.676037 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.676130 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260923 19:41:17.676525 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:34395: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
I20260923 19:41:17.767791 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } attempt: 3
I20260923 19:41:17.769083 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.768625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56702)
0923 19:41:17.768851 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.768943 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260923 19:41:17.770169 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.769831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56712)
0923 19:41:17.769956 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.770026 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 19:41:17.770437 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:34395: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
I20260923 19:41:17.913689 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } attempt: 4
I20260923 19:41:17.915071 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.914519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56728)
0923 19:41:17.914848 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.914933 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
I20260923 19:41:17.916162 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:17.915736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56740)
0923 19:41:17.915888 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:17.915999 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260923 19:41:17.916383 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:34395: Network error: Client connection negotiation failed: client connection to 127.12.159.253:34395: connect: Connection refused (error 111)
W20260923 19:41:17.926784 2916 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:41:17.927175 2916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:17.927301 2916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:17.927443 2916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:17.934777 2916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:17.934913 2916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:17.935015 2916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:17.935114 2916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:17.935209 2916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:17.945999 2916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:42529,127.12.159.253:34395,127.12.159.252:34987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab
--principal=kudu/127.12.159.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:34395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.159.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:17.947743 2916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:17.949010 2916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:17.961145 2921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:17.961229 2922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:17.961229 2924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:17.962268 2916 server_base.cc:1034] running on GCE node
I20260923 19:41:17.963131 2916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:17.964766 2916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:17.966022 2916 hybrid_clock.cc:648] HybridClock initialized: now 1790192477965954 us; error 59 us; skew 500 ppm
I20260923 19:41:17.966405 2916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:17 dist-test-slave-lzv7 krb5kdc[2829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:17.969993 2916 init.cc:377] Logged in from keytab as kudu/127.12.159.253@KRBTEST.COM (short username kudu)
I20260923 19:41:17.971531 2916 webserver.cc:460] Webserver started at http://127.12.159.253:39865/ using document root <none> and password file <none>
I20260923 19:41:17.972283 2916 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:17.972378 2916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:17.972643 2916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:17.975905 2916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data/instance:
uuid: "df87f356b2b443099ee66df162c26ebe"
format_stamp: "Formatted at 2026-09-23 19:41:17 on dist-test-slave-lzv7"
server_key: "1c49a5acafc12ad780d9d6e5fcabe7f2"
server_key_iv: "09f3943b2293adba3eb97263fdc499fe"
server_key_version: "encryptionkey@0"
I20260923 19:41:17.976719 2916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/wal/instance:
uuid: "df87f356b2b443099ee66df162c26ebe"
format_stamp: "Formatted at 2026-09-23 19:41:17 on dist-test-slave-lzv7"
server_key: "1c49a5acafc12ad780d9d6e5fcabe7f2"
server_key_iv: "09f3943b2293adba3eb97263fdc499fe"
server_key_version: "encryptionkey@0"
I20260923 19:41:17.982383 2916 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260923 19:41:17.985869 2931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:17.987442 2916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:17.987628 2916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/wal
uuid: "df87f356b2b443099ee66df162c26ebe"
format_stamp: "Formatted at 2026-09-23 19:41:17 on dist-test-slave-lzv7"
server_key: "1c49a5acafc12ad780d9d6e5fcabe7f2"
server_key_iv: "09f3943b2293adba3eb97263fdc499fe"
server_key_version: "encryptionkey@0"
I20260923 19:41:17.987866 2916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:18.015426 2916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:18.020152 2916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:18.020437 2916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:18.039469 2916 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.253:34395
I20260923 19:41:18.039506 2982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.253:34395 every 8 connection(s)
I20260923 19:41:18.040894 2916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
I20260923 19:41:18.044844 2983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:18.048707 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2916
I20260923 19:41:18.048923 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-1/wal/instance
I20260923 19:41:18.049479 12927 external_mini_cluster.cc:1428] Setting key 36638f8685eb00fdaaf3fccfd681cdd8
I20260923 19:41:18.053702 2983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.252@KRBTEST.COM; defaulting to no policy
I20260923 19:41:18.080286 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.057455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32992 (local address 127.12.159.254:42529)
0923 19:41:18.058058 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.058066 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.059370 (+ 1304us) server_negotiation.cc:407] Connection header received
0923 19:41:18.062522 (+ 3152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.062527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.062608 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.062718 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.065311 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.066314 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.069184 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.070028 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.070192 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.074118 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.074123 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.074127 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.074177 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.077004 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.077837 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.077845 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.077850 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.077980 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.078426 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.078432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.078436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.078748 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.078906 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.079655 (+ 749us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.079897 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":282,"threads_started":1}
I20260923 19:41:18.081281 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.058225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:42529 (local address 127.0.0.1:32992)
0923 19:41:18.059151 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.059201 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.062168 (+ 2967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.063102 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.063120 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.064060 (+ 940us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.065029 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.065063 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.066508 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.066517 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.068955 (+ 2438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.068975 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.070307 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.070317 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.070676 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.071476 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.071500 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.073853 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.077179 (+ 3326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.077190 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.077210 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.077677 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.078100 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.078106 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.078110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.078307 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.078895 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.078904 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.079287 (+ 383us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.079573 (+ 286us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.080140 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":444,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.252@KRBTEST.COM" created.
I20260923 19:41:18.083128 2983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:18.100569 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.083978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56754)
0923 19:41:18.084211 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.084236 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.084363 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.085306 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.085313 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.085850 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.086063 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.086077 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.087557 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.087565 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.089069 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.089087 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.090041 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.090050 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.090304 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.091010 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.091038 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.093690 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.098154 (+ 4464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.098158 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.098161 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.098525 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.098966 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.098969 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.098972 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.099104 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.099865 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.099872 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.099991 (+ 119us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.100106 (+ 115us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.100306 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260923 19:41:18.101104 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.084158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56754 (local address 127.12.159.253:34395)
0923 19:41:18.084861 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.084867 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.084893 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:41:18.084942 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.084948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.085123 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.085245 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.086280 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.087396 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.089228 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.089881 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.089990 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.093964 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.093981 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.094002 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.094045 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.098003 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.098667 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.098679 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.098685 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.098856 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.099210 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.099218 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.099223 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.099720 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.099949 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.100280 (+ 331us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.100583 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":413,"threads_started":1}
I20260923 19:41:18.103623 2983 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:41:18.104859 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.104370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60560)
0923 19:41:18.104548 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.104687 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260923 19:41:18.105136 2932 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.106714 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.106395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60566)
0923 19:41:18.106543 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.106620 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 19:41:18.106910 2983 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab.
Entry for principal kudu/127.12.159.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab.
I20260923 19:41:18.117617 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:34987
--webserver_interface=127.12.159.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab
--principal=kudu/127.12.159.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:38113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:42529,127.12.159.253:34395,127.12.159.252:34987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:41:18.156168 2983 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 1
I20260923 19:41:18.157359 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.156805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60578)
0923 19:41:18.157037 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.157168 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260923 19:41:18.158586 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.158227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60588)
0923 19:41:18.158401 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.158480 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260923 19:41:18.158983 2983 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.215693 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } attempt: 5
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:18.227222 2983 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 2
I20260923 19:41:18.228157 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.227736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60602)
0923 19:41:18.227916 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.228004 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260923 19:41:18.229161 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.228840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60616)
0923 19:41:18.228985 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.229058 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260923 19:41:18.229478 2983 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.230405 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.216719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.12.159.253:34395)
0923 19:41:18.216957 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.216965 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.216994 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:41:18.217066 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.217071 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.217170 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.217298 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.218138 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.219211 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.220373 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.221055 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.221180 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.224462 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.224467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.224470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.224503 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.227102 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.227968 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.227974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.227977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.228154 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.228691 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.228699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.228705 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.229179 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.229957 (+ 778us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.230059 (+ 102us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.230217 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260923 19:41:18.230536 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.216600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:56768)
0923 19:41:18.216799 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.216824 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.216947 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.217329 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.217332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.217698 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.217963 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.217974 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.219354 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.219358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.220209 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.220219 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.221204 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.221208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.221400 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.222073 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.222091 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.224276 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.227310 (+ 3034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.227315 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.227319 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.227813 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.228309 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.228317 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.228322 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.228514 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.229347 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.229356 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.229569 (+ 213us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.229730 (+ 161us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.230169 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260923 19:41:18.231534 2909 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:41:18.232609 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.232194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60620)
0923 19:41:18.232367 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.232457 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260923 19:41:18.233601 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.233242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:60636)
0923 19:41:18.233384 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.233477 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:41:18.233831 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.285137 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 1
I20260923 19:41:18.286582 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.285991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46288)
0923 19:41:18.286217 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.286347 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 19:41:18.287834 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.287390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46302)
0923 19:41:18.287573 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.287676 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260923 19:41:18.288062 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.320713 2983 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 3
I20260923 19:41:18.322187 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.321593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46306)
0923 19:41:18.321926 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.322019 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260923 19:41:18.323343 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.322921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46310)
0923 19:41:18.323145 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.323225 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260923 19:41:18.323590 2983 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.356281 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 2
I20260923 19:41:18.357524 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.357020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46312)
0923 19:41:18.357262 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.357356 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260923 19:41:18.358629 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.358271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46316)
0923 19:41:18.358431 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.358511 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 19:41:18.358863 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
W20260923 19:41:18.459368 2991 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:41:18.459795 2991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:18.459919 2991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:18.460074 2991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 19:41:18.465054 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 3
I20260923 19:41:18.466192 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.465716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46320)
0923 19:41:18.465940 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.466030 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260923 19:41:18.466775 2983 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 4
I20260923 19:41:18.467262 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.466879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46330)
0923 19:41:18.467093 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.467169 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260923 19:41:18.467514 2909 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.467710 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.467288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46340)
0923 19:41:18.467467 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.467549 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 19:41:18.468495 2991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:18.468621 2991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:18.468729 2991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260923 19:41:18.468806 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.468405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46346)
0923 19:41:18.468528 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.468627 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 19:41:18.468819 2991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:18.468904 2991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:41:18.469010 2983 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:34987: Network error: Client connection negotiation failed: client connection to 127.12.159.252:34987: connect: Connection refused (error 111)
I20260923 19:41:18.479336 2991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:38113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:42529,127.12.159.253:34395,127.12.159.252:34987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab
--principal=kudu/127.12.159.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:34987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.159.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:18.480629 2991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:18.482075 2991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:18.494488 2997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:18.494575 2999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:18.494661 2996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:18.496047 2991 server_base.cc:1034] running on GCE node
I20260923 19:41:18.496901 2991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:18.498452 2991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:18.499668 2991 hybrid_clock.cc:648] HybridClock initialized: now 1790192478499588 us; error 76 us; skew 500 ppm
I20260923 19:41:18.500011 2991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192478, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:18.503331 2991 init.cc:377] Logged in from keytab as kudu/127.12.159.252@KRBTEST.COM (short username kudu)
I20260923 19:41:18.504841 2991 webserver.cc:460] Webserver started at http://127.12.159.252:44705/ using document root <none> and password file <none>
I20260923 19:41:18.505553 2991 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:18.505640 2991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:18.506011 2991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:18.508889 2991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data/instance:
uuid: "bbe686602a6e43dcafb5bb85819e958d"
format_stamp: "Formatted at 2026-09-23 19:41:18 on dist-test-slave-lzv7"
server_key: "1e0e1ba6ce5e4e6335c87b172556056f"
server_key_iv: "1b4f6e461c9d535116ba1e1896290195"
server_key_version: "encryptionkey@0"
I20260923 19:41:18.509752 2991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/wal/instance:
uuid: "bbe686602a6e43dcafb5bb85819e958d"
format_stamp: "Formatted at 2026-09-23 19:41:18 on dist-test-slave-lzv7"
server_key: "1e0e1ba6ce5e4e6335c87b172556056f"
server_key_iv: "1b4f6e461c9d535116ba1e1896290195"
server_key_version: "encryptionkey@0"
I20260923 19:41:18.515138 2991 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:41:18.518600 3006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:18.519851 2991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:18.520035 2991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/wal
uuid: "bbe686602a6e43dcafb5bb85819e958d"
format_stamp: "Formatted at 2026-09-23 19:41:18 on dist-test-slave-lzv7"
server_key: "1e0e1ba6ce5e4e6335c87b172556056f"
server_key_iv: "1b4f6e461c9d535116ba1e1896290195"
server_key_version: "encryptionkey@0"
I20260923 19:41:18.520346 2991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:18.557065 2991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:18.561864 2991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:18.562155 2991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:18.580978 2991 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.252:34987
I20260923 19:41:18.581000 3057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.252:34987 every 8 connection(s)
I20260923 19:41:18.582511 2991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
I20260923 19:41:18.583636 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 2991
I20260923 19:41:18.583848 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192117815085-12927-0/minicluster-data/master-2/wal/instance
I20260923 19:41:18.584364 12927 external_mini_cluster.cc:1428] Setting key 3424318ce47464491fe2513d0f7c2f45
I20260923 19:41:18.587275 3058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:18.594367 3058 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192478, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:41:18.606837 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.586434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46348 (local address 127.12.159.252:34987)
0923 19:41:18.587191 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.587203 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.587272 (+ 69us) server_negotiation.cc:407] Connection header received
0923 19:41:18.588902 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.588923 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.589309 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.589729 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.591227 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.592790 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.594151 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.594830 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.595063 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.599708 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.599716 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.599733 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.599771 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.602773 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.603489 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.603496 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.603502 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.603702 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.604103 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.604113 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.604115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.604593 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.604950 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.605397 (+ 447us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.605783 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":343,"threads_started":1}
I20260923 19:41:18.611419 3063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.596825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34506 (local address 127.12.159.254:42529)
0923 19:41:18.598258 (+ 1433us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.598262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.598278 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:41:18.598326 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.598330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.598393 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.598481 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.599678 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.600360 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.601858 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.602277 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.602412 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.605520 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.605525 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.605529 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.605595 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.608428 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.609190 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.609196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.609199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.609346 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.609779 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.609784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.609787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.610130 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.610326 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.610817 (+ 491us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.611073 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1284,"thread_start_us":1126,"threads_started":1}
I20260923 19:41:18.611485 3062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.596719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:42529 (local address 127.0.0.1:34506)
0923 19:41:18.597525 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.597577 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.597733 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.598592 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.598599 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.599271 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.599507 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.599516 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.600536 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.600548 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.601654 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.601665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.602482 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.602488 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.602663 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.603260 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.603286 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.605320 (+ 2034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.608573 (+ 3253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.608585 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.608592 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.609030 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.609498 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.609501 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.609503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.609658 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.610301 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.610309 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.610494 (+ 185us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.610704 (+ 210us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.611049 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":326,"threads_started":1}
I20260923 19:41:18.613132 3058 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192478, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:18.626667 3064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.609784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34514 (local address 127.12.159.254:42529)
0923 19:41:18.610449 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.610453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.610572 (+ 119us) server_negotiation.cc:407] Connection header received
0923 19:41:18.610748 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.610753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.610819 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.610930 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.612569 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.614297 (+ 1728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.615818 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.616317 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.616448 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.621157 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.621162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.621165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.621197 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.623803 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.624545 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.624551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.624555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.624698 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.625106 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.625112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.625115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.625389 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.625663 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.626063 (+ 400us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.626293 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":297,"threads_started":1}
I20260923 19:41:18.626804 3062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.614007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:34395 (local address 127.0.0.1:55226)
0923 19:41:18.614208 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.614230 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.614341 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.614653 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.614656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.614988 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.615143 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.615151 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.616291 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.616296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.617269 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.617281 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.618325 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.618330 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.618473 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.619039 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.619055 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.621083 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.624300 (+ 3217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.624306 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.624310 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.624676 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.625063 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.625068 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.625072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.625215 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.625722 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.625727 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.625914 (+ 187us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.626105 (+ 191us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.626437 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 19:41:18.627012 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.614112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55226 (local address 127.12.159.253:34395)
0923 19:41:18.614318 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.614323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.614340 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:41:18.614452 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.614457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.614541 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.614645 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.615293 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.616126 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.617418 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.618152 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.618314 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.621284 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.621288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.621307 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.621339 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.624150 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.624810 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.624815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.624824 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.624948 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.625335 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.625341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.625344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.625593 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.625765 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.626231 (+ 466us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.626645 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:41:18.628108 3058 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192478, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:18.642877 3062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.628941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46354)
0923 19:41:18.629185 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.629202 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.629302 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.629611 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.629614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.630027 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.630158 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.630165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.631364 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.631368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.632643 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.632659 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.633395 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.633400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.633568 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.634210 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.634244 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.636538 (+ 2294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.640429 (+ 3891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.640433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.640436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.640798 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.641192 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.641199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.641204 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.641347 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.641854 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.641858 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.641987 (+ 129us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.642139 (+ 152us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.642437 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260923 19:41:18.642927 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.628912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46354 (local address 127.12.159.252:34987)
0923 19:41:18.629059 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.629063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.629270 (+ 207us) server_negotiation.cc:407] Connection header received
0923 19:41:18.629421 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.629427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.629498 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.629608 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.630298 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.631239 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.632786 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.633241 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.633352 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.636711 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.636717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.636722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.636757 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.640277 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.640945 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.640952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.640955 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.641084 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.641452 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.641459 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.641462 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.641718 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.641895 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.642227 (+ 332us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.642598 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":134,"server-negotiator.queue_time_us":55}
I20260923 19:41:18.644735 2909 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 4
I20260923 19:41:18.646170 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.628574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55242 (local address 127.12.159.253:34395)
0923 19:41:18.628768 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.628773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.628815 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:41:18.628993 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.629000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.629072 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.629174 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.630707 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.631612 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.633145 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.633706 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.633888 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.638847 (+ 4959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.638855 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.638860 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.638903 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.642481 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.643432 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.643439 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.643443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.643724 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.644141 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.644147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.644150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.644528 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.645420 (+ 892us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.645526 (+ 106us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.645778 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:41:18.650312 3058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: Bootstrap starting.
I20260923 19:41:18.652120 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
I20260923 19:41:18.655323 3058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:18.657128 3058 log.cc:824] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:18.660370 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.645487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46360)
0923 19:41:18.645709 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.645730 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.645882 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.646620 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.646629 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.647226 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.647483 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.647499 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.648700 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.648705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.650089 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.650100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.650918 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.650924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.651102 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.651790 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.651815 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.653944 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.657077 (+ 3133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.657084 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.657088 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.657605 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.658176 (+ 571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.658184 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.658195 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.658417 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.659251 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.659255 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.659456 (+ 201us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.659623 (+ 167us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.659935 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260923 19:41:18.660513 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.646032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46360 (local address 127.12.159.252:34987)
0923 19:41:18.646245 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.646250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.646271 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:41:18.646319 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.646324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.646395 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.646510 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.647650 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.648570 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.650222 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.650766 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.650899 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.654117 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.654122 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.654125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.654153 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.656937 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.657744 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.657752 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.657755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.657957 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.658609 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.658618 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.658622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.659080 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.659282 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.659786 (+ 504us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.660058 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:41:18.661113 3058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: No bootstrap required, opened a new log
I20260923 19:41:18.656731 2884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34514
I20260923 19:41:18.667237 2909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f: Bootstrap starting.
I20260923 19:41:18.668728 3058 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
I20260923 19:41:18.669117 3058 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe686602a6e43dcafb5bb85819e958d, State: Initialized, Role: FOLLOWER
I20260923 19:41:18.669543 3058 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
I20260923 19:41:18.671501 3058 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:18.671150 3066 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.671918 3066 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:18.672273 2909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:18.673895 2909 log.cc:824] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:18.681535 2909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f: No bootstrap required, opened a new log
I20260923 19:41:18.682937 2991 master_runner.cc:186] Error getting master registration for 127.12.159.254:42529: OK, instance_id { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" instance_seqno: 1790192477495585 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:41:18.694191 2991 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260923 19:41:18.697106 3078 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:41:18.697268 3078 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:41:18.697458 2909 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
I20260923 19:41:18.698150 2909 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f74f1a131224a1a9419bf8bbd7e7f0f, State: Initialized, Role: FOLLOWER
I20260923 19:41:18.698784 2909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
I20260923 19:41:18.699990 3080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.700448 3080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:18.701639 2909 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:18.701666 2884 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 19:41:18.701952 2884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:18.705289 2884 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
I20260923 19:41:18.707962 2884 leader_election.cc:288] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [CANDIDATE]: Term 1 election: Requested vote from peers df87f356b2b443099ee66df162c26ebe (127.12.159.253:34395), bbe686602a6e43dcafb5bb85819e958d (127.12.159.252:34987)
I20260923 19:41:18.708849 3033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bbe686602a6e43dcafb5bb85819e958d"
I20260923 19:41:18.709357 3033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:18.714192 3033 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f74f1a131224a1a9419bf8bbd7e7f0f in term 1.
I20260923 19:41:18.715066 2858 leader_election.cc:302] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f74f1a131224a1a9419bf8bbd7e7f0f, bbe686602a6e43dcafb5bb85819e958d; no voters:
I20260923 19:41:18.715865 3080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:18.717592 2842 master_runner.cc:186] Error getting master registration for 127.12.159.253:34395: OK, instance_id { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" instance_seqno: 1790192478034182 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:41:18.729522 2842 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:41:18.730415 3080 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [term 1 LEADER]: Becoming Leader. State: Replica: 4f74f1a131224a1a9419bf8bbd7e7f0f, State: Running, Role: LEADER
I20260923 19:41:18.731237 3080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
W20260923 19:41:18.734731 2863 tablet.cc:2369] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:41:18.740594 3091 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:41:18.740752 3091 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:41:18.746785 3093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f74f1a131224a1a9419bf8bbd7e7f0f. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.747457 3093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:18.755971 3101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:18.768234 2983 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } attempt: 5
I20260923 19:41:18.770442 3101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:18.783504 3033 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [term 1 FOLLOWER]: Refusing update from remote peer 4f74f1a131224a1a9419bf8bbd7e7f0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:18.785181 3093 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:18.792922 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.744759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.12.159.252:34987)
0923 19:41:18.744966 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.744972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.764982 (+ 20010us) server_negotiation.cc:407] Connection header received
0923 19:41:18.765206 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.765211 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.765314 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.765448 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.769006 (+ 3558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.770227 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.772343 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.773174 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.773347 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.780743 (+ 7396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.780750 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.780755 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.780799 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.787178 (+ 6379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.788548 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.788556 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.788559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.788847 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.789597 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.789602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.789635 (+ 33us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.790315 (+ 680us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.790752 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.791773 (+ 1021us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.792202 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Sep 23 19:41:18 dist-test-slave-lzv7 krb5kdc[2829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
I20260923 19:41:18.796763 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.744574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.12.159.253:34395)
0923 19:41:18.744985 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.744991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.757502 (+ 12511us) server_negotiation.cc:407] Connection header received
0923 19:41:18.757756 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.757763 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.757892 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.758004 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.767458 (+ 9454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.768626 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.771658 (+ 3032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.772365 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.772586 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.782002 (+ 9416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.782010 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.782018 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.782070 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.786114 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.792079 (+ 5965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.792085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.792090 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.792291 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.792850 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.792855 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.792858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.793246 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.793479 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.796127 (+ 2648us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.796382 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278}
I20260923 19:41:18.804219 3064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.743711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34518 (local address 127.12.159.254:42529)
0923 19:41:18.744309 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.744318 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.767999 (+ 23681us) server_negotiation.cc:407] Connection header received
0923 19:41:18.768263 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.768269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.768352 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.768421 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.772577 (+ 4156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.773722 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.777258 (+ 3536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.777973 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.778073 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.793774 (+ 15701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.793787 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.793791 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.793853 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.797452 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.799205 (+ 1753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.799211 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.799214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.799375 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.799841 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.799847 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.799850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.800603 (+ 753us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.802477 (+ 1874us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.802844 (+ 367us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.803411 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441}
I20260923 19:41:18.809180 2986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.768975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:34987 (local address 127.0.0.1:46378)
0923 19:41:18.769159 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:18.769181 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:18.769288 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:18.777637 (+ 8349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:18.777645 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:18.778267 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:18.778506 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.778520 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.781753 (+ 3233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.781760 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.783499 (+ 1739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:18.783520 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.789583 (+ 6063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.789593 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:18.789902 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.790665 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:18.790690 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:18.795564 (+ 4874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:18.804802 (+ 9238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.804811 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.804817 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.805443 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.806981 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:18.806987 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:18.806991 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:18.807175 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:18.807933 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:18.807939 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:18.808189 (+ 250us) client_negotiation.cc:769] Sending connection context
0923 19:41:18.808340 (+ 151us) client_negotiation.cc:240] Negotiation successful
0923 19:41:18.808702 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260923 19:41:18.810472 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:18.769390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46378 (local address 127.12.159.252:34987)
0923 19:41:18.774282 (+ 4892us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:18.774288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:18.774315 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:41:18.774366 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:18.774372 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:18.774486 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:18.778679 (+ 4193us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:18.779025 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.780495 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.787662 (+ 7167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:18.789290 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:18.795787 (+ 6497us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:18.796167 (+ 380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:18.796177 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:18.796186 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:18.796233 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:18.802139 (+ 5906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.806599 (+ 4460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.806605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.806609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.806823 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:18.807337 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:18.807343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:18.807353 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:18.807766 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:18.809582 (+ 1816us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:18.809725 (+ 143us) server_negotiation.cc:299] Negotiation successful
0923 19:41:18.810010 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":525,"threads_started":1}
I20260923 19:41:18.814183 3066 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f74f1a131224a1a9419bf8bbd7e7f0f. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.814491 3066 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:18.816591 2983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe: Bootstrap starting.
W20260923 19:41:18.817026 3012 tablet.cc:2369] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:41:18.818375 3105 mvcc.cc:205] Tried to move back new op lower bound from 7332628393080676352 to 7332628392889610240. Current Snapshot: MvccSnapshot[applied={T|T < 7332628393080676352}]
I20260923 19:41:18.826685 2983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:18.827895 3080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.828245 3080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:18.828902 3066 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.829182 3066 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:18.829185 2983 log.cc:824] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:18.831277 3101 catalog_manager.cc:1347] Generated new cluster ID: 0c97e7c495454beb958a2f1cb29e0d41
I20260923 19:41:18.831384 3101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:18.847162 2983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe: No bootstrap required, opened a new log
I20260923 19:41:18.847538 3104 mvcc.cc:205] Tried to move back new op lower bound from 7332628393080676352 to 7332628392889610240. Current Snapshot: MvccSnapshot[applied={T|T < 7332628393080676352 or (T in {7332628393080676352})}]
I20260923 19:41:18.868925 2983 raft_consensus.cc:348] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
I20260923 19:41:18.869797 2983 raft_consensus.cc:729] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df87f356b2b443099ee66df162c26ebe, State: Initialized, Role: FOLLOWER
I20260923 19:41:18.870849 2983 consensus_queue.cc:260] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } }
I20260923 19:41:18.884047 2957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:18.885063 3101 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:18.887183 3101 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:18.887825 2957 raft_consensus.cc:1261] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [term 1 FOLLOWER]: Refusing update from remote peer 4f74f1a131224a1a9419bf8bbd7e7f0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:18.888531 2958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "df87f356b2b443099ee66df162c26ebe"
I20260923 19:41:18.892113 2958 raft_consensus.cc:2454] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f74f1a131224a1a9419bf8bbd7e7f0f in term 1.
I20260923 19:41:18.892872 3080 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:18.896598 2983 sys_catalog.cc:564] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:18.910888 3101 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f: Generated new TSK 0
I20260923 19:41:18.912139 3101 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:18.971110 3110 sys_catalog.cc:455] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.971575 3110 sys_catalog.cc:458] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:18.971405 3093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.971719 3093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f74f1a131224a1a9419bf8bbd7e7f0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:18.972096 3111 sys_catalog.cc:455] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f74f1a131224a1a9419bf8bbd7e7f0f. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.972494 3111 sys_catalog.cc:458] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:18.974462 3118 sys_catalog.cc:455] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f74f1a131224a1a9419bf8bbd7e7f0f" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 42529 } } peers { permanent_uuid: "df87f356b2b443099ee66df162c26ebe" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 34395 } } peers { permanent_uuid: "bbe686602a6e43dcafb5bb85819e958d" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 34987 } } }
I20260923 19:41:18.974890 3118 sys_catalog.cc:458] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:19.001595 3128 catalog_manager.cc:1259] Loaded cluster ID: 0c97e7c495454beb958a2f1cb29e0d41
I20260923 19:41:19.001835 3128 catalog_manager.cc:1552] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe: loading cluster ID for follower catalog manager: success
I20260923 19:41:19.006280 3128 catalog_manager.cc:1574] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe: acquiring CA information for follower catalog manager: success
I20260923 19:41:19.009308 3128 catalog_manager.cc:1602] T 00000000000000000000000000000000 P df87f356b2b443099ee66df162c26ebe: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 19:41:19.090054 2988 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.065966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55268 (local address 127.12.159.253:34395)
0923 19:41:19.066197 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.066205 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.087590 (+ 21385us) server_negotiation.cc:407] Connection header received
0923 19:41:19.088419 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.088427 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.088546 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.088629 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.089796 (+ 1167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55268: BlockingRecv error: recv got EOF from 127.0.0.1:55268 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260923 19:41:19.093822 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.072697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46392 (local address 127.12.159.252:34987)
0923 19:41:19.072893 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.072900 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.091327 (+ 18427us) server_negotiation.cc:407] Connection header received
0923 19:41:19.091788 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.091794 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.091897 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.091975 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.093560 (+ 1585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46392: BlockingRecv error: recv got EOF from 127.0.0.1:46392 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260923 19:41:19.096028 3064 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.085900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34524 (local address 127.12.159.254:42529)
0923 19:41:19.086122 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.086130 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.092601 (+ 6471us) server_negotiation.cc:407] Connection header received
0923 19:41:19.094604 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.094609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.094691 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.094799 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.095768 (+ 969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34524: BlockingRecv error: recv got EOF from 127.0.0.1:34524 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:41:19.143989 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.124783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55280 (local address 127.12.159.253:34395)
0923 19:41:19.124974 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.124981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.135725 (+ 10744us) server_negotiation.cc:407] Connection header received
0923 19:41:19.136294 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.136301 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.136519 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.136674 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.137376 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.138608 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.140696 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.141436 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.141547 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.142358 (+ 811us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.143136 (+ 778us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.143276 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.143519 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.143626 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260923 19:41:19.194267 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.180960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46402 (local address 127.12.159.252:34987)
0923 19:41:19.181159 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.181165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.191895 (+ 10730us) server_negotiation.cc:407] Connection header received
0923 19:41:19.192561 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.192568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.192712 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.192796 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.193961 (+ 1165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46402: BlockingRecv error: recv got EOF from 127.0.0.1:46402 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:41:19.249015 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.230673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55286 (local address 127.12.159.253:34395)
0923 19:41:19.230867 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.230874 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.241896 (+ 11022us) server_negotiation.cc:407] Connection header received
0923 19:41:19.242431 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.242438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.242570 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.242638 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.243293 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.244496 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.246628 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.247386 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.247490 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.248124 (+ 634us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.248288 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.248350 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.248580 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.248677 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 19:41:19.297827 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.284593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46410 (local address 127.12.159.252:34987)
0923 19:41:19.284791 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.284797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.295585 (+ 10788us) server_negotiation.cc:407] Connection header received
0923 19:41:19.296141 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.296152 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.296255 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.296339 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.297546 (+ 1207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46410: BlockingRecv error: recv got EOF from 127.0.0.1:46410 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:41:19.353408 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.335385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55296 (local address 127.12.159.253:34395)
0923 19:41:19.335597 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.335604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.346289 (+ 10685us) server_negotiation.cc:407] Connection header received
0923 19:41:19.346855 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.346862 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.346959 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.347027 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.347742 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.348926 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.351054 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.351769 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.351876 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.352499 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.352666 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.352727 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.352957 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.353050 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260923 19:41:19.395167 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.383148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46414 (local address 127.12.159.252:34987)
0923 19:41:19.383383 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.383392 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.393271 (+ 9879us) server_negotiation.cc:407] Connection header received
0923 19:41:19.393526 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.393533 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.393682 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.393768 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.394912 (+ 1144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46414: BlockingRecv error: recv got EOF from 127.0.0.1:46414 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:41:19.439872 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.431693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55302 (local address 127.12.159.253:34395)
0923 19:41:19.431948 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.431955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.432935 (+ 980us) server_negotiation.cc:407] Connection header received
0923 19:41:19.433164 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.433171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.433274 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.433389 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.433957 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.435415 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.437540 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.438254 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.438394 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.438929 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.439083 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.439198 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.439387 (+ 189us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.439481 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
W20260923 19:41:19.453590 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.451210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46416 (local address 127.12.159.252:34987)
0923 19:41:19.451473 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.451480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.451994 (+ 514us) server_negotiation.cc:407] Connection header received
0923 19:41:19.452183 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.452187 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.452263 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.452365 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.453333 (+ 968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46416: BlockingRecv error: recv got EOF from 127.0.0.1:46416 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
I20260923 19:41:19.471681 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.465522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55308 (local address 127.12.159.253:34395)
0923 19:41:19.465731 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.465737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.466069 (+ 332us) server_negotiation.cc:407] Connection header received
0923 19:41:19.466305 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.466309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.466375 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.466447 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.466915 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.467715 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.469612 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.470104 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.470196 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.470766 (+ 570us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.470906 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.470990 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.471165 (+ 175us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.471229 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260923 19:41:19.479631 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.477689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46430 (local address 127.12.159.252:34987)
0923 19:41:19.477942 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.477949 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.478246 (+ 297us) server_negotiation.cc:407] Connection header received
0923 19:41:19.478461 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.478466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.478550 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.478665 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.479364 (+ 699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46430: BlockingRecv error: recv got EOF from 127.0.0.1:46430 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260923 19:41:19.506453 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.499217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55310 (local address 127.12.159.253:34395)
0923 19:41:19.499441 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.499447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.499777 (+ 330us) server_negotiation.cc:407] Connection header received
0923 19:41:19.499996 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.500000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.500084 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.500153 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.500726 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.502037 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.504164 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.504845 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.505001 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.505534 (+ 533us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.505697 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.505799 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.506073 (+ 274us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.506170 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260923 19:41:19.522607 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.513557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46442 (local address 127.12.159.252:34987)
0923 19:41:19.513742 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.513748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.520762 (+ 7014us) server_negotiation.cc:407] Connection header received
0923 19:41:19.521026 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.521033 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.521122 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.521195 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.522381 (+ 1186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46442: BlockingRecv error: recv got EOF from 127.0.0.1:46442 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:41:19.566288 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.559337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55320 (local address 127.12.159.253:34395)
0923 19:41:19.559575 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.559583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.560120 (+ 537us) server_negotiation.cc:407] Connection header received
0923 19:41:19.560250 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.560258 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.560381 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.560460 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.561056 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.561925 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.564084 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.564583 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.564684 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.565329 (+ 645us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.565442 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.565512 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.565722 (+ 210us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.565797 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260923 19:41:19.575866 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.573727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46446 (local address 127.12.159.252:34987)
0923 19:41:19.573964 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.573973 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.574354 (+ 381us) server_negotiation.cc:407] Connection header received
0923 19:41:19.574574 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.574579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.574671 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.574814 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.575581 (+ 767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46446: BlockingRecv error: recv got EOF from 127.0.0.1:46446 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
I20260923 19:41:19.649004 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.643803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55322 (local address 127.12.159.253:34395)
0923 19:41:19.644055 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.644062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.644322 (+ 260us) server_negotiation.cc:407] Connection header received
0923 19:41:19.644559 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.644566 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.644653 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.644761 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.645199 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.645974 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.647292 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.647716 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.647873 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.648263 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.648385 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.648487 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.648646 (+ 159us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.648729 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
W20260923 19:41:19.656647 3103 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:19.654798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46462 (local address 127.12.159.252:34987)
0923 19:41:19.655091 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.655098 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.655316 (+ 218us) server_negotiation.cc:407] Connection header received
0923 19:41:19.655484 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.655488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.655561 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.655676 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:19.656398 (+ 722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46462: BlockingRecv error: recv got EOF from 127.0.0.1:46462 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
I20260923 19:41:19.699347 3078 catalog_manager.cc:1259] Loaded cluster ID: 0c97e7c495454beb958a2f1cb29e0d41
I20260923 19:41:19.699447 3078 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: loading cluster ID for follower catalog manager: success
I20260923 19:41:19.702061 3078 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: acquiring CA information for follower catalog manager: success
I20260923 19:41:19.703974 3078 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bbe686602a6e43dcafb5bb85819e958d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:41:19.793421 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.788347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55328 (local address 127.12.159.253:34395)
0923 19:41:19.788535 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.788539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.788879 (+ 340us) server_negotiation.cc:407] Connection header received
0923 19:41:19.789044 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.789049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.789127 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.789219 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.789603 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.790312 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.791793 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.792219 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.792322 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.792807 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.792923 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.792989 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.793126 (+ 137us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.793190 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:41:19.807147 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.800790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46478 (local address 127.12.159.252:34987)
0923 19:41:19.801022 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.801032 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.801751 (+ 719us) server_negotiation.cc:407] Connection header received
0923 19:41:19.801976 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.801981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.802133 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.802238 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.802643 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.803379 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.804770 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.805172 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.805320 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.805951 (+ 631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.806498 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.806672 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.806754 (+ 82us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.806846 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:41:19.823571 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.813562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.12.159.252:34987)
0923 19:41:19.813743 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.813750 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.816830 (+ 3080us) server_negotiation.cc:407] Connection header received
0923 19:41:19.817026 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.817033 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.817144 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.817232 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.818024 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.818955 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.821399 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.822116 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.822189 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.822772 (+ 583us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.822915 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.823016 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.823171 (+ 155us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.823270 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:41:19.823572 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.813986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55338 (local address 127.12.159.253:34395)
0923 19:41:19.814184 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.814193 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.816327 (+ 2134us) server_negotiation.cc:407] Connection header received
0923 19:41:19.816691 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.816701 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.816833 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.816911 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.817593 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.818670 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.820875 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.821731 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.821887 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.822834 (+ 947us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.822946 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.823027 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.823258 (+ 231us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.823333 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260923 19:41:19.824395 3233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:19.813419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34538 (local address 127.12.159.254:42529)
0923 19:41:19.817359 (+ 3940us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:19.817364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:19.817382 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:41:19.817498 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:19.817506 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:19.817737 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:19.817978 (+ 241us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:19.818514 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.819640 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.822017 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:19.822630 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:19.823168 (+ 538us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:19.823378 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:19.823774 (+ 396us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:19.823899 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:19.823992 (+ 93us) server_negotiation.cc:299] Negotiation successful
0923 19:41:19.824071 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3815,"thread_start_us":3703,"threads_started":1}
I20260923 19:41:19.830389 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2842
I20260923 19:41:19.831420 2904 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:19.944042 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2842
W20260923 19:41:19.966531 3009 connection.cc:535] server connection from 127.0.0.1:46360 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:41:19.967154 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2916
I20260923 19:41:19.968302 2978 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:20.078229 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2916
I20260923 19:41:20.099037 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 2991
I20260923 19:41:20.100243 3053 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:20.208343 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 2991
2026-09-23T19:41:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4554 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:20 dist-test-slave-lzv7 krb5kdc[3241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:20 dist-test-slave-lzv7 krb5kdc[3241](info): set up 2 sockets
Sep 23 19:41:20 dist-test-slave-lzv7 krb5kdc[3241](info): commencing operation
krb5kdc: starting...
W20260923 19:41:21.339221 12927 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/test-user.keytab.
Sep 23 19:41:21 dist-test-slave-lzv7 krb5kdc[3241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.159.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
Entry for principal kudu/127.12.159.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab.
I20260923 19:41:21.613608 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33941
--webserver_interface=127.12.159.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33941,127.12.159.253:40713,127.12.159.252:38003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:21.968142 3254 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:41:21.968510 3254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:21.968621 3254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:21.968765 3254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:21.976290 3254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:21.976384 3254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:21.976490 3254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:21.976590 3254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:21.976677 3254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:21.987120 3254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33941,127.12.159.253:40713,127.12.159.252:38003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.254.keytab
--principal=kudu/127.12.159.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.254:33941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.159.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:21.988485 3254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:21.990129 3254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:22.002521 3259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:22.002489 3260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:22.003032 3262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:22.003379 3254 server_base.cc:1034] running on GCE node
I20260923 19:41:22.004108 3254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:22.005671 3254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:22.006937 3254 hybrid_clock.cc:648] HybridClock initialized: now 1790192482006859 us; error 74 us; skew 500 ppm
I20260923 19:41:22.007313 3254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:22 dist-test-slave-lzv7 krb5kdc[3241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:22.010682 3254 init.cc:377] Logged in from keytab as kudu/127.12.159.254@KRBTEST.COM (short username kudu)
I20260923 19:41:22.012301 3254 webserver.cc:460] Webserver started at http://127.12.159.254:38443/ using document root <none> and password file <none>
I20260923 19:41:22.012997 3254 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:22.013099 3254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:22.013376 3254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:22.016569 3254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data/instance:
uuid: "f99b21cee4e24173a78e2db6309ca0ce"
format_stamp: "Formatted at 2026-09-23 19:41:22 on dist-test-slave-lzv7"
server_key: "d79fc3d8dded50b754daffa2810278ec"
server_key_iv: "f4b09d50db80d1f68cd4ffc99ce25774"
server_key_version: "encryptionkey@0"
I20260923 19:41:22.017403 3254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/wal/instance:
uuid: "f99b21cee4e24173a78e2db6309ca0ce"
format_stamp: "Formatted at 2026-09-23 19:41:22 on dist-test-slave-lzv7"
server_key: "d79fc3d8dded50b754daffa2810278ec"
server_key_iv: "f4b09d50db80d1f68cd4ffc99ce25774"
server_key_version: "encryptionkey@0"
I20260923 19:41:22.022979 3254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:41:22.026526 3269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:22.027899 3254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:22.028088 3254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/wal
uuid: "f99b21cee4e24173a78e2db6309ca0ce"
format_stamp: "Formatted at 2026-09-23 19:41:22 on dist-test-slave-lzv7"
server_key: "d79fc3d8dded50b754daffa2810278ec"
server_key_iv: "f4b09d50db80d1f68cd4ffc99ce25774"
server_key_version: "encryptionkey@0"
I20260923 19:41:22.028335 3254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:22.049602 3254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:22.054355 3254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:22.054672 3254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:22.074419 3254 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.254:33941
I20260923 19:41:22.074559 3320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.254:33941 every 8 connection(s)
I20260923 19:41:22.075891 3254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:22.079803 3321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:22.081588 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 3254
I20260923 19:41:22.081794 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-0/wal/instance
I20260923 19:41:22.082391 12927 external_mini_cluster.cc:1428] Setting key fdb5e9f2f7c77a9d7ef0d588ab2852c6
I20260923 19:41:22.089898 3321 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:22 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.253@KRBTEST.COM" created.
I20260923 19:41:22.114738 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.094137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33941 (local address 127.0.0.1:42794)
0923 19:41:22.095054 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.095099 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:22.097259 (+ 2160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:22.098237 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:22.098243 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:22.099005 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:22.099358 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.099376 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.100947 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.100952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.102163 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.102175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.103125 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.103132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.103359 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.104106 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:22.104128 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:22.106686 (+ 2558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:22.110217 (+ 3531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.110228 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.110241 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.110625 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.111058 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.111065 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.111071 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.111249 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.112194 (+ 945us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:22.112207 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:22.112426 (+ 219us) client_negotiation.cc:769] Sending connection context
0923 19:41:22.112673 (+ 247us) client_negotiation.cc:240] Negotiation successful
0923 19:41:22.113284 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":164,"thread_start_us":461,"threads_started":1}
I20260923 19:41:22.114780 3325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.095595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42794 (local address 127.12.159.254:33941)
0923 19:41:22.096404 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:22.096413 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:22.096467 (+ 54us) server_negotiation.cc:407] Connection header received
0923 19:41:22.097669 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:22.097675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:22.098004 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:22.098225 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:22.099582 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.100786 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.102307 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.102877 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.103110 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.106927 (+ 3817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:22.106935 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:22.106947 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:22.106975 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:22.110062 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.110790 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.110798 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.110806 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.110944 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.111429 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.111434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.111437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.112042 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:22.112272 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:22.112810 (+ 538us) server_negotiation.cc:299] Negotiation successful
0923 19:41:22.113160 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":413,"threads_started":1}
I20260923 19:41:22.118192 3321 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:41:22.119443 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.119027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43442)
0923 19:41:22.119210 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.119322 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260923 19:41:22.119733 3273 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
I20260923 19:41:22.121377 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.120987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43448)
0923 19:41:22.121158 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.121242 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260923 19:41:22.121723 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:40713: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab.
Entry for principal kudu/127.12.159.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab.
I20260923 19:41:22.145985 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:40713
--webserver_interface=127.12.159.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab
--principal=kudu/127.12.159.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33941,127.12.159.253:40713,127.12.159.252:38003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:41:22.171145 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } attempt: 1
I20260923 19:41:22.172420 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.171942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43462)
0923 19:41:22.172149 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.172282 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260923 19:41:22.173667 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.173076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43466)
0923 19:41:22.173234 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.173520 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 19:41:22.173942 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:40713: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
I20260923 19:41:22.242254 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } attempt: 2
I20260923 19:41:22.243532 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.243003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43478)
0923 19:41:22.243289 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.243386 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260923 19:41:22.244753 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.244328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43484)
0923 19:41:22.244519 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.244613 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260923 19:41:22.244968 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:40713: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
I20260923 19:41:22.336254 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } attempt: 3
I20260923 19:41:22.337539 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.337057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43498)
0923 19:41:22.337282 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.337382 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260923 19:41:22.338708 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.338332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43504)
0923 19:41:22.338489 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.338571 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:41:22.338905 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:40713: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
I20260923 19:41:22.482192 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } attempt: 4
I20260923 19:41:22.483636 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.483066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43516)
0923 19:41:22.483421 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.483508 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260923 19:41:22.484706 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.484339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43524)
0923 19:41:22.484491 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.484577 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 19:41:22.484890 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.253:40713: Network error: Client connection negotiation failed: client connection to 127.12.159.253:40713: connect: Connection refused (error 111)
W20260923 19:41:22.494148 3328 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:41:22.494553 3328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:22.494685 3328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:22.494829 3328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:22.502357 3328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:22.502504 3328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:22.502679 3328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:22.502791 3328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:22.502882 3328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:22.513005 3328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33941,127.12.159.253:40713,127.12.159.252:38003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.253.keytab
--principal=kudu/127.12.159.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.253:40713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.159.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:22.514441 3328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:22.515830 3328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:22.530145 3333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:22.530206 3334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:22.530177 3336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:22.531384 3328 server_base.cc:1034] running on GCE node
I20260923 19:41:22.532327 3328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:22.533977 3328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:22.535257 3328 hybrid_clock.cc:648] HybridClock initialized: now 1790192482535168 us; error 47 us; skew 500 ppm
I20260923 19:41:22.535683 3328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:22 dist-test-slave-lzv7 krb5kdc[3241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:22.539232 3328 init.cc:377] Logged in from keytab as kudu/127.12.159.253@KRBTEST.COM (short username kudu)
I20260923 19:41:22.540750 3328 webserver.cc:460] Webserver started at http://127.12.159.253:43345/ using document root <none> and password file <none>
I20260923 19:41:22.541565 3328 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:22.541710 3328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:22.542126 3328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:22.545452 3328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data/instance:
uuid: "c5e00fedffd5486280539a3b86460594"
format_stamp: "Formatted at 2026-09-23 19:41:22 on dist-test-slave-lzv7"
server_key: "7eed0d1deeb336b31a9d737a10f087f1"
server_key_iv: "0c3c1a5bbbdf77bf175179968ef30e82"
server_key_version: "encryptionkey@0"
I20260923 19:41:22.546324 3328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/wal/instance:
uuid: "c5e00fedffd5486280539a3b86460594"
format_stamp: "Formatted at 2026-09-23 19:41:22 on dist-test-slave-lzv7"
server_key: "7eed0d1deeb336b31a9d737a10f087f1"
server_key_iv: "0c3c1a5bbbdf77bf175179968ef30e82"
server_key_version: "encryptionkey@0"
I20260923 19:41:22.551437 3328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:41:22.555058 3343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:22.556598 3328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:22.556818 3328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/wal
uuid: "c5e00fedffd5486280539a3b86460594"
format_stamp: "Formatted at 2026-09-23 19:41:22 on dist-test-slave-lzv7"
server_key: "7eed0d1deeb336b31a9d737a10f087f1"
server_key_iv: "0c3c1a5bbbdf77bf175179968ef30e82"
server_key_version: "encryptionkey@0"
I20260923 19:41:22.557055 3328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:22.584625 3328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:22.589205 3328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:22.589500 3328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:22.608330 3328 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.253:40713
I20260923 19:41:22.608361 3394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.253:40713 every 8 connection(s)
I20260923 19:41:22.609791 3328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/data/info.pb
I20260923 19:41:22.612449 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 3328
I20260923 19:41:22.612653 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-1/wal/instance
I20260923 19:41:22.613222 12927 external_mini_cluster.cc:1428] Setting key 54c72737c4991c9930b759503adaaddb
I20260923 19:41:22.614259 3395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:22.624825 3395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:22 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.159.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.159.252@KRBTEST.COM" created.
I20260923 19:41:22.649655 3398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.628358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42802 (local address 127.12.159.254:33941)
0923 19:41:22.628894 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:22.628899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:22.630005 (+ 1106us) server_negotiation.cc:407] Connection header received
0923 19:41:22.632127 (+ 2122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:22.632133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:22.632226 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:22.632360 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:22.634609 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.635402 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.637899 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.638308 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.638406 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.642916 (+ 4510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:22.642921 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:22.642934 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:22.642979 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:22.645884 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.646823 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.646828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.646830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.646948 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.647435 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.647439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.647442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.647767 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:22.647891 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:22.648923 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0923 19:41:22.649192 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":318,"threads_started":1}
I20260923 19:41:22.650921 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.629012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33941 (local address 127.0.0.1:42802)
0923 19:41:22.629787 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.629891 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:22.631783 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:22.632679 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:22.632694 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:22.633533 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:22.634387 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.634415 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.635595 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.635603 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.637700 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.637718 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.638553 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.638563 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.638925 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.639701 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:22.639737 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:22.642650 (+ 2913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:22.646036 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.646045 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.646065 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.646637 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.647067 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.647074 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.647078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.647273 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.647910 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:22.647921 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:22.648457 (+ 536us) client_negotiation.cc:769] Sending connection context
0923 19:41:22.648781 (+ 324us) client_negotiation.cc:240] Negotiation successful
0923 19:41:22.649380 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":315,"threads_started":1}
I20260923 19:41:22.652855 3395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:22 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:22.670298 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.653886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43528 (local address 127.12.159.253:40713)
0923 19:41:22.654594 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:22.654599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:22.654625 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:41:22.654668 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:22.654675 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:22.654853 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:22.655023 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:22.655747 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.656917 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.658264 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.659247 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.659391 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.663045 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:22.663061 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:22.663082 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:22.663131 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:22.667195 (+ 4064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.667995 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.668007 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.668010 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.668142 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.668588 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.668591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.668593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.668950 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:22.669132 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:22.669600 (+ 468us) server_negotiation.cc:299] Negotiation successful
0923 19:41:22.669977 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":223,"server-negotiator.queue_time_us":549,"thread_start_us":409,"threads_started":1}
I20260923 19:41:22.670388 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.653733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43528)
0923 19:41:22.653954 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.653970 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:22.654061 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:22.655006 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:22.655010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:22.655444 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:22.655577 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.655585 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.657090 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.657095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.658118 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.658131 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.659418 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.659422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.659594 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.660333 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:22.660351 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:22.662805 (+ 2454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:22.667369 (+ 4564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.667374 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.667377 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.667812 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.668284 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.668291 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.668298 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.668470 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.669091 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:22.669099 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:22.669294 (+ 195us) client_negotiation.cc:769] Sending connection context
0923 19:41:22.669448 (+ 154us) client_negotiation.cc:240] Negotiation successful
0923 19:41:22.669827 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":2}
I20260923 19:41:22.673149 3395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:41:22.674419 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.673772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34242)
0923 19:41:22.674030 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.674170 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260923 19:41:22.674787 3345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
I20260923 19:41:22.676463 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.676036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34248)
0923 19:41:22.676217 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.676296 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 19:41:22.676695 3395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.159.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab.
Entry for principal kudu/127.12.159.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab.
I20260923 19:41:22.685484 12927 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
/tmp/dist-test-taskWWieFZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:38003
--webserver_interface=127.12.159.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab
--principal=kudu/127.12.159.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.159.212:35255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.159.254:33941,127.12.159.253:40713,127.12.159.252:38003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:41:22.726006 3395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 1
I20260923 19:41:22.727313 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.726727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34260)
0923 19:41:22.726962 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.727089 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260923 19:41:22.728420 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.727983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34264)
0923 19:41:22.728177 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.728285 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260923 19:41:22.728672 3395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
I20260923 19:41:22.784125 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } attempt: 5
Sep 23 19:41:22 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:22.796904 3395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 2
I20260923 19:41:22.798120 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.797556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34278)
0923 19:41:22.797749 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.797895 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 19:41:22.799316 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.798846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34286)
0923 19:41:22.799036 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.799119 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260923 19:41:22.799754 3395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
I20260923 19:41:22.800549 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.785218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43544 (local address 127.12.159.253:40713)
0923 19:41:22.785402 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:22.785407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:22.785427 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:41:22.785631 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:22.785635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:22.785707 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:22.785860 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:22.786833 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.787530 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.789173 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.789601 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.789709 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.793420 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:22.793427 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:22.793432 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:22.793474 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:22.797046 (+ 3572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.798059 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.798067 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.798070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.798450 (+ 380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:22.798898 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:22.798903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:22.798908 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:22.799338 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:22.799498 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:22.799981 (+ 483us) server_negotiation.cc:299] Negotiation successful
0923 19:41:22.800223 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:41:22.800589 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.785007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43544)
0923 19:41:22.785331 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.785355 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:22.785483 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:22.785909 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:22.785914 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:22.786442 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:22.786673 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.786685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.787674 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.787679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.789015 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:22.789036 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:22.789767 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:22.789772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:22.790029 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:22.790692 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:22.790714 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:22.793195 (+ 2481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:22.797277 (+ 4082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.797284 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.797291 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.797927 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.798584 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:22.798590 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:22.798593 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:22.798766 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:22.799519 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:22.799526 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:22.799688 (+ 162us) client_negotiation.cc:769] Sending connection context
0923 19:41:22.799844 (+ 156us) client_negotiation.cc:240] Negotiation successful
0923 19:41:22.800220 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260923 19:41:22.801867 3321 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:41:22.802874 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.802487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34292)
0923 19:41:22.802648 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.802741 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 19:41:22.803772 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.803441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34296)
0923 19:41:22.803577 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.803673 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:41:22.803997 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
I20260923 19:41:22.855263 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 1
I20260923 19:41:22.856809 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.856131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34306)
0923 19:41:22.856454 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.856583 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260923 19:41:22.858007 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.857560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34308)
0923 19:41:22.857730 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.857864 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 19:41:22.858316 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
I20260923 19:41:22.891139 3395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 3
I20260923 19:41:22.892380 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.891898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34318)
0923 19:41:22.892109 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.892221 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260923 19:41:22.893512 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.893108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34328)
0923 19:41:22.893325 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.893399 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
W20260923 19:41:22.893781 3395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
I20260923 19:41:22.926587 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 2
I20260923 19:41:22.928014 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.927345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34342)
0923 19:41:22.927642 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.927770 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260923 19:41:22.929061 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:22.928728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34352)
0923 19:41:22.928885 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:22.928957 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 19:41:22.929328 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
W20260923 19:41:23.028759 3403 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:41:23.029181 3403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:23.029314 3403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:23.029460 3403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 19:41:23.035548 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 3
I20260923 19:41:23.036784 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.036314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34354)
0923 19:41:23.036522 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.036623 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260923 19:41:23.037072 3395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 4
W20260923 19:41:23.037974 3403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260923 19:41:23.038008 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.037534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34370)
0923 19:41:23.037757 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.037868 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260923 19:41:23.038084 3403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:23.038211 3403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:23.038264 3321 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
W20260923 19:41:23.038326 3403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260923 19:41:23.038326 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.037752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34380)
0923 19:41:23.038006 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.038121 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260923 19:41:23.038412 3403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:23.039337 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.038972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34396)
0923 19:41:23.039132 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.039213 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 19:41:23.039655 3395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.159.252:38003: Network error: Client connection negotiation failed: client connection to 127.12.159.252:38003: connect: Connection refused (error 111)
I20260923 19:41:23.048830 3403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.159.212:35255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.159.254:33941,127.12.159.253:40713,127.12.159.252:38003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/krb5kdc/kudu_127.12.159.252.keytab
--principal=kudu/127.12.159.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.159.252:38003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.159.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:23.050293 3403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:23.051580 3403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:23.063860 3411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:23.063928 3408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:23.063939 3409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:23.067420 3403 server_base.cc:1034] running on GCE node
I20260923 19:41:23.068293 3403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:23.069924 3403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:23.071246 3403 hybrid_clock.cc:648] HybridClock initialized: now 1790192483071165 us; error 46 us; skew 500 ppm
I20260923 19:41:23.071696 3403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192483, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:23.075187 3403 init.cc:377] Logged in from keytab as kudu/127.12.159.252@KRBTEST.COM (short username kudu)
I20260923 19:41:23.082451 3403 webserver.cc:460] Webserver started at http://127.12.159.252:35819/ using document root <none> and password file <none>
I20260923 19:41:23.083204 3403 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:23.083341 3403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:23.083667 3403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:23.086807 3403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data/instance:
uuid: "2414fbade4ac42cf8926f0a23e3835bd"
format_stamp: "Formatted at 2026-09-23 19:41:23 on dist-test-slave-lzv7"
server_key: "ace1646946fd37efe000a092667e9bc5"
server_key_iv: "9fa0ad46f15934e8aeb25546ab597e49"
server_key_version: "encryptionkey@0"
I20260923 19:41:23.087610 3403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/wal/instance:
uuid: "2414fbade4ac42cf8926f0a23e3835bd"
format_stamp: "Formatted at 2026-09-23 19:41:23 on dist-test-slave-lzv7"
server_key: "ace1646946fd37efe000a092667e9bc5"
server_key_iv: "9fa0ad46f15934e8aeb25546ab597e49"
server_key_version: "encryptionkey@0"
I20260923 19:41:23.092892 3403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:41:23.096342 3418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:23.097587 3403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:23.097846 3403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data,/tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/wal
uuid: "2414fbade4ac42cf8926f0a23e3835bd"
format_stamp: "Formatted at 2026-09-23 19:41:23 on dist-test-slave-lzv7"
server_key: "ace1646946fd37efe000a092667e9bc5"
server_key_iv: "9fa0ad46f15934e8aeb25546ab597e49"
server_key_version: "encryptionkey@0"
I20260923 19:41:23.098095 3403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:23.122026 3403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:23.126361 3403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:23.126646 3403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:23.144783 3403 rpc_server.cc:307] RPC server started. Bound to: 127.12.159.252:38003
I20260923 19:41:23.144876 3469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.159.252:38003 every 8 connection(s)
I20260923 19:41:23.146255 3403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/data/info.pb
I20260923 19:41:23.150259 3470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:23.151655 12927 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu as pid 3403
I20260923 19:41:23.151841 12927 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWWieFZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192117815085-12927-0/minicluster-data/master-2/wal/instance
I20260923 19:41:23.152290 12927 external_mini_cluster.cc:1428] Setting key 86cb4e436cd71dc5ca2a8ab84c54b1ef
I20260923 19:41:23.160066 3470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192483, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
I20260923 19:41:23.176656 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.154207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34400 (local address 127.12.159.252:38003)
0923 19:41:23.155071 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.155088 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.155145 (+ 57us) server_negotiation.cc:407] Connection header received
0923 19:41:23.156969 (+ 1824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.156998 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.157525 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.158015 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.159225 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.161298 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.162766 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.163788 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.163920 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.168696 (+ 4776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.168704 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.168714 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.168749 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.172452 (+ 3703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.173138 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.173152 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.173159 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.173330 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.173791 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.173794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.173796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.174372 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.174670 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.175115 (+ 445us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.175514 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":366,"threads_started":1}
I20260923 19:41:23.178872 3474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.163066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42808 (local address 127.12.159.254:33941)
0923 19:41:23.163644 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.163653 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.164627 (+ 974us) server_negotiation.cc:407] Connection header received
0923 19:41:23.164853 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.164858 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.164941 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.165029 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.166563 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.167253 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.168670 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.169228 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.169362 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.172788 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.172793 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.172796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.172834 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.175926 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.176665 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.176672 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.176675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.176869 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.177262 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.177267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.177271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.177526 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.177684 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.178250 (+ 566us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.178465 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":271,"threads_started":1}
I20260923 19:41:23.178894 3475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.163134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.254:33941 (local address 127.0.0.1:42808)
0923 19:41:23.164464 (+ 1330us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.164497 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:23.164688 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:23.165154 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:23.165162 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:23.166032 (+ 870us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:23.166400 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.166414 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.167413 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.167418 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.168511 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.168523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.169419 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.169426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.169598 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.170305 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:23.170325 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:23.172588 (+ 2263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:23.176057 (+ 3469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.176069 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.176077 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.176519 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.176986 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.176991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.176995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.177127 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.177659 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:23.177667 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:23.177925 (+ 258us) client_negotiation.cc:769] Sending connection context
0923 19:41:23.178121 (+ 196us) client_negotiation.cc:240] Negotiation successful
0923 19:41:23.178466 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1149,"thread_start_us":1054,"threads_started":1}
I20260923 19:41:23.181540 3470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.254@KRBTEST.COM
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192483, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:23.195353 3474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.179853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42820 (local address 127.12.159.254:33941)
0923 19:41:23.180095 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.180099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.180112 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:41:23.180152 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.180156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.180232 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.180351 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.181933 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.182858 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.184327 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.184842 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.184977 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.189680 (+ 4703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.189687 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.189692 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.189741 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.192624 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.193303 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.193309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.193313 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.193441 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.193840 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.193844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.193847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.194115 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.194407 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.194746 (+ 339us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.194984 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":318,"threads_started":1}
I20260923 19:41:23.195650 3475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.182245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.253:40713 (local address 127.0.0.1:43558)
0923 19:41:23.182409 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.182429 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:23.182532 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:23.182888 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:23.182892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:23.183457 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:23.183646 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.183660 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.184823 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.184829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.186124 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.186136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.187166 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.187171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.187313 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.187900 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:23.187917 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:23.190212 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:23.193161 (+ 2949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.193167 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.193171 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.193545 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.194000 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.194004 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.194008 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.194155 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.194688 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:23.194693 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:23.194852 (+ 159us) client_negotiation.cc:769] Sending connection context
0923 19:41:23.195009 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 19:41:23.195304 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260923 19:41:23.195675 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.182392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43558 (local address 127.12.159.253:40713)
0923 19:41:23.182575 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.182581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.182600 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:41:23.182656 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.182661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.182729 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.182825 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.183818 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.184657 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.186276 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.187002 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.187148 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.190412 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.190417 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.190420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.190453 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.193017 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.193680 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.193695 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.193697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.193880 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.194278 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.194284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.194287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.194569 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.194731 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.195110 (+ 379us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.195315 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:41:23.196733 3470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192483, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.252@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.159.253@KRBTEST.COM
I20260923 19:41:23.209569 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.197508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.12.159.252:38003)
0923 19:41:23.197647 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.197652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.197667 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:41:23.197765 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.197769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.197870 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.197979 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.198816 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.199494 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.200598 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.200993 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.201124 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.204298 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.204304 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.204308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.204344 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.207083 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.207706 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.207711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.207714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.207827 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.208189 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.208194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.208199 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.208470 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.208623 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.208992 (+ 369us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.209201 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 19:41:23.209686 3475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.197421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34416)
0923 19:41:23.197561 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.197578 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:23.197669 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:23.197992 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:23.197996 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:23.198520 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:23.198684 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.198694 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.199618 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.199626 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.200461 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.200471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.201158 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.201165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.201381 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.202030 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:23.202047 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:23.204133 (+ 2086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:23.207224 (+ 3091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.207230 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.207234 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.207573 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.207951 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.207955 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.207959 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.208088 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.208586 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:23.208590 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:23.208728 (+ 138us) client_negotiation.cc:769] Sending connection context
0923 19:41:23.208907 (+ 179us) client_negotiation.cc:240] Negotiation successful
0923 19:41:23.209353 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":148}
I20260923 19:41:23.211683 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.197104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43574 (local address 127.12.159.253:40713)
0923 19:41:23.197683 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.197687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.197700 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:41:23.197744 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.197747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.197797 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.197964 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.199109 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.199796 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.200982 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.201500 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.201714 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.206202 (+ 4488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.206214 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.206217 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.206247 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.208939 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.209588 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.209595 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.209599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.209801 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.210256 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.210263 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.210266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.210530 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.210827 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.211101 (+ 274us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.211333 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:41:23.215327 3470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: Bootstrap starting.
I20260923 19:41:23.215508 3321 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 4
I20260923 19:41:23.217099 12927 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:23.219385 3470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:23.220446 3470 log.cc:824] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:23.219729 3296 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f99b21cee4e24173a78e2db6309ca0ce"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42820
I20260923 19:41:23.224210 3470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: No bootstrap required, opened a new log
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.254@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
I20260923 19:41:23.232430 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.216312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.12.159.252:38003)
0923 19:41:23.216520 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.216526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.216541 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:41:23.216589 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.216593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.216645 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.216754 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.217662 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.218744 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.220742 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.221498 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.221637 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.225734 (+ 4097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.225745 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.225750 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.225781 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.229516 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.230302 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.230308 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.230311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.230453 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.230869 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.230874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.230877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.231195 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.231366 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.231814 (+ 448us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.232048 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:41:23.232450 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.216068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34418)
0923 19:41:23.216254 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.216272 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:23.216418 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:23.216782 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:23.216787 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:23.217315 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:23.217499 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.217510 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.218921 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.218926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.220509 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.220524 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.221704 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.221714 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.221943 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.222621 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:23.222647 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:23.225541 (+ 2894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:23.229672 (+ 4131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.229677 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.229682 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.230136 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.230575 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.230580 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.230583 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.230752 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.231328 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:23.231333 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:23.231495 (+ 162us) client_negotiation.cc:769] Sending connection context
0923 19:41:23.231717 (+ 222us) client_negotiation.cc:240] Negotiation successful
0923 19:41:23.232006 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260923 19:41:23.234251 3470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.234712 3470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2414fbade4ac42cf8926f0a23e3835bd, State: Initialized, Role: FOLLOWER
I20260923 19:41:23.235244 3470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.236223 3478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.236595 3478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:23.237522 3470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:23.238461 3321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce: Bootstrap starting.
I20260923 19:41:23.243553 3321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:23.245236 3321 log.cc:824] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:23.249310 3321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce: No bootstrap required, opened a new log
W20260923 19:41:23.255254 3490 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:41:23.255465 3490 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:41:23.257290 3321 raft_consensus.cc:348] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.257769 3321 raft_consensus.cc:729] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99b21cee4e24173a78e2db6309ca0ce, State: Initialized, Role: FOLLOWER
I20260923 19:41:23.258373 3321 consensus_queue.cc:260] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.259631 3492 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.260376 3492 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:23.260859 3321 sys_catalog.cc:564] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:23.260972 3296 raft_consensus.cc:482] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 19:41:23.261183 3296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:23.264657 3296 raft_consensus.cc:504] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.252903 3403 master_runner.cc:186] Error getting master registration for 127.12.159.254:33941: OK, instance_id { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" instance_seqno: 1790192482068875 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:41:23.267022 3403 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:41:23.267824 3296 leader_election.cc:288] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [CANDIDATE]: Term 1 election: Requested vote from peers c5e00fedffd5486280539a3b86460594 (127.12.159.253:40713), 2414fbade4ac42cf8926f0a23e3835bd (127.12.159.252:38003)
I20260923 19:41:23.268604 3445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f99b21cee4e24173a78e2db6309ca0ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2414fbade4ac42cf8926f0a23e3835bd"
I20260923 19:41:23.269536 3445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:23.275267 3445 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99b21cee4e24173a78e2db6309ca0ce in term 1.
I20260923 19:41:23.276752 3271 leader_election.cc:302] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2414fbade4ac42cf8926f0a23e3835bd, f99b21cee4e24173a78e2db6309ca0ce; no voters:
I20260923 19:41:23.277418 3492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:23.278286 3492 raft_consensus.cc:686] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [term 1 LEADER]: Becoming Leader. State: Replica: f99b21cee4e24173a78e2db6309ca0ce, State: Running, Role: LEADER
I20260923 19:41:23.278952 3492 consensus_queue.cc:237] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.284232 3497 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader f99b21cee4e24173a78e2db6309ca0ce. Latest consensus state: current_term: 1 leader_uuid: "f99b21cee4e24173a78e2db6309ca0ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.284797 3497 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:23.303299 3501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260923 19:41:23.307713 3275 tablet.cc:2369] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:41:23.324633 3501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:23.335466 3514 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:41:23.338830 3395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } attempt: 5
I20260923 19:41:23.356204 3474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.309945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42830 (local address 127.12.159.254:33941)
0923 19:41:23.310177 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.310188 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.323493 (+ 13305us) server_negotiation.cc:407] Connection header received
0923 19:41:23.326567 (+ 3074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.326576 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.326677 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.326768 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.331566 (+ 4798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.333031 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.335661 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.336547 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.336671 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.346391 (+ 9720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.346407 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.346421 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.346489 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.351739 (+ 5250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.352745 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.352751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.352754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.352956 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.353488 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.353496 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.353502 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.354125 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.354482 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.355165 (+ 683us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.355514 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 19:41:23.341416 3254 master_runner.cc:186] Error getting master registration for 127.12.159.253:40713: OK, instance_id { permanent_uuid: "c5e00fedffd5486280539a3b86460594" instance_seqno: 1790192482602889 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:41:23.363585 3254 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:41:23.373031 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.324161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34432 (local address 127.12.159.252:38003)
0923 19:41:23.324363 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.324371 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.335002 (+ 10631us) server_negotiation.cc:407] Connection header received
0923 19:41:23.342263 (+ 7261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.342271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.342378 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.342462 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.344664 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.346004 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.351653 (+ 5649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.352391 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.352516 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.362458 (+ 9942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.362469 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.362478 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.362529 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.366948 (+ 4419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.368687 (+ 1739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.368697 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.368704 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.368945 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.369588 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.369597 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.369604 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.370159 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.370530 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.372051 (+ 1521us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.372415 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260923 19:41:23.378731 3424 tablet.cc:2369] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:41:23.380088 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.318350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.12.159.253:40713)
0923 19:41:23.318598 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.318609 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.330489 (+ 11880us) server_negotiation.cc:407] Connection header received
0923 19:41:23.330950 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.330959 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.331090 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.331187 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.333769 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.335021 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.339282 (+ 4261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.340023 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.340131 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.368660 (+ 28529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.368668 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.368674 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.368728 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.373140 (+ 4412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.374838 (+ 1698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.374844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.374847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.375045 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.377236 (+ 2191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.377247 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.377253 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.377910 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.378279 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.379123 (+ 844us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.379486 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Sep 23 19:41:23 dist-test-slave-lzv7 krb5kdc[3241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.159.253@KRBTEST.COM for kudu/127.12.159.252@KRBTEST.COM
I20260923 19:41:23.387320 3445 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [term 1 FOLLOWER]: Refusing update from remote peer f99b21cee4e24173a78e2db6309ca0ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:23.388703 3497 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:23.394280 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.339453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.159.252:38003 (local address 127.0.0.1:34438)
0923 19:41:23.339905 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:23.339924 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:23.340037 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:23.373684 (+ 33647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:23.373689 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:23.374173 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:23.374400 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.374414 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.376703 (+ 2289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.376709 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.378201 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:23.378221 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.380101 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.380108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:23.380389 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.381123 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:23.381146 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:23.384129 (+ 2983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:23.390145 (+ 6016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.390151 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.390155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.390779 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.391347 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:23.391353 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:23.391357 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:23.391602 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:23.392901 (+ 1299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:23.392906 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:23.393109 (+ 203us) client_negotiation.cc:769] Sending connection context
0923 19:41:23.393270 (+ 161us) client_negotiation.cc:240] Negotiation successful
0923 19:41:23.393648 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316}
I20260923 19:41:23.395787 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:23.340259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34438 (local address 127.12.159.252:38003)
0923 19:41:23.373309 (+ 33050us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.373314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.373333 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:41:23.373383 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.373391 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.373500 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.373658 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.374904 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.376533 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.378441 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:23.379850 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:23.384422 (+ 4572us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:23.384968 (+ 546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:23.384976 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:23.384981 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:23.385054 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:23.389954 (+ 4900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.390969 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.390975 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.390978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.391169 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:23.392239 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:23.392247 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:23.392253 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:23.392742 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:23.394719 (+ 1977us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:23.394860 (+ 141us) server_negotiation.cc:299] Negotiation successful
0923 19:41:23.395134 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32941,"thread_start_us":45551,"threads_started":1}
I20260923 19:41:23.404131 3395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594: Bootstrap starting.
I20260923 19:41:23.409639 3395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:23.411403 3395 log.cc:824] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:23.419713 3478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f99b21cee4e24173a78e2db6309ca0ce. Latest consensus state: current_term: 1 leader_uuid: "f99b21cee4e24173a78e2db6309ca0ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.420212 3478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:23.430300 3497 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f99b21cee4e24173a78e2db6309ca0ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.430660 3497 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:23.432781 3501 catalog_manager.cc:1347] Generated new cluster ID: e9b80ccf8afc475aa6cdcef43f916685
I20260923 19:41:23.432900 3501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:23.433151 3517 mvcc.cc:205] Tried to move back new op lower bound from 7332628411844358144 to 7332628411516555264. Current Snapshot: MvccSnapshot[applied={T|T < 7332628411844358144}]
I20260923 19:41:23.434921 3478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f99b21cee4e24173a78e2db6309ca0ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.435300 3478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:23.441498 3395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594: No bootstrap required, opened a new log
I20260923 19:41:23.454397 3395 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.454907 3395 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e00fedffd5486280539a3b86460594, State: Initialized, Role: FOLLOWER
I20260923 19:41:23.455511 3395 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } }
I20260923 19:41:23.457119 3522 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.458177 3522 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:23.458524 3395 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:23.458526 3370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f99b21cee4e24173a78e2db6309ca0ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c5e00fedffd5486280539a3b86460594"
I20260923 19:41:23.459043 3370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:23.464128 3501 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:23.465950 3501 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:23.471552 3370 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99b21cee4e24173a78e2db6309ca0ce in term 1.
I20260923 19:41:23.472800 3369 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [term 1 FOLLOWER]: Refusing update from remote peer f99b21cee4e24173a78e2db6309ca0ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:23.475382 3497 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:23.492165 3501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce: Generated new TSK 0
I20260923 19:41:23.493309 3501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:23.539306 3526 mvcc.cc:205] Tried to move back new op lower bound from 7332628411844358144 to 7332628411516555264. Current Snapshot: MvccSnapshot[applied={T|T < 7332628411844358144}]
I20260923 19:41:23.554018 3525 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f99b21cee4e24173a78e2db6309ca0ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.554770 3525 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:23.555249 3522 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f99b21cee4e24173a78e2db6309ca0ce. Latest consensus state: current_term: 1 leader_uuid: "f99b21cee4e24173a78e2db6309ca0ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.555595 3522 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:41:23.557595 3492 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f99b21cee4e24173a78e2db6309ca0ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99b21cee4e24173a78e2db6309ca0ce" member_type: VOTER last_known_addr { host: "127.12.159.254" port: 33941 } } peers { permanent_uuid: "c5e00fedffd5486280539a3b86460594" member_type: VOTER last_known_addr { host: "127.12.159.253" port: 40713 } } peers { permanent_uuid: "2414fbade4ac42cf8926f0a23e3835bd" member_type: VOTER last_known_addr { host: "127.12.159.252" port: 38003 } } }
I20260923 19:41:23.558185 3492 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99b21cee4e24173a78e2db6309ca0ce [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:23.585078 3539 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260923 19:41:23.611141 12927 mini_kdc.cc:348] Time spent kdestroy: real 0.107s user 0.002s sys 0.026s
W20260923 19:41:23.673225 3474 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.653200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42840 (local address 127.12.159.254:33941)
0923 19:41:23.653432 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.653440 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.670742 (+ 17302us) server_negotiation.cc:407] Connection header received
0923 19:41:23.671595 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.671601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.671712 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.671825 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.672942 (+ 1117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42840: BlockingRecv error: recv got EOF from 127.0.0.1:42840 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260923 19:41:23.675382 3473 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.671151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34446 (local address 127.12.159.252:38003)
0923 19:41:23.671317 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.671323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.673886 (+ 2563us) server_negotiation.cc:407] Connection header received
0923 19:41:23.674109 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.674115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.674194 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.674264 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.675156 (+ 892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34446: BlockingRecv error: recv got EOF from 127.0.0.1:34446 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260923 19:41:23.677410 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.653959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43588 (local address 127.12.159.253:40713)
0923 19:41:23.654167 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.654175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.671469 (+ 17294us) server_negotiation.cc:407] Connection header received
0923 19:41:23.675982 (+ 4513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.675988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.676067 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.676132 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.677198 (+ 1066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43588: BlockingRecv error: recv got EOF from 127.0.0.1:43588 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260923 19:41:23.687899 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.683392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43592 (local address 127.12.159.253:40713)
0923 19:41:23.683558 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.683564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.686325 (+ 2761us) server_negotiation.cc:407] Connection header received
0923 19:41:23.686551 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.686558 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.686696 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.686814 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.687602 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43592: BlockingRecv error: recv got EOF from 127.0.0.1:43592 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260923 19:41:23.705859 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.703558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.12.159.253:40713)
0923 19:41:23.703781 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.703788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.704299 (+ 511us) server_negotiation.cc:407] Connection header received
0923 19:41:23.704518 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.704527 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.704617 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.704727 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.705612 (+ 885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43600: BlockingRecv error: recv got EOF from 127.0.0.1:43600 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260923 19:41:23.714550 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.712209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43602 (local address 127.12.159.253:40713)
0923 19:41:23.712393 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.712401 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.712916 (+ 515us) server_negotiation.cc:407] Connection header received
0923 19:41:23.713121 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.713129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.713240 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.713353 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.714299 (+ 946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43602: BlockingRecv error: recv got EOF from 127.0.0.1:43602 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260923 19:41:23.724370 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.722019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43606 (local address 127.12.159.253:40713)
0923 19:41:23.722254 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.722261 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.722798 (+ 537us) server_negotiation.cc:407] Connection header received
0923 19:41:23.723031 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.723040 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.723172 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.723298 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.724139 (+ 841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43606: BlockingRecv error: recv got EOF from 127.0.0.1:43606 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
W20260923 19:41:23.742063 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.739662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43622 (local address 127.12.159.253:40713)
0923 19:41:23.739884 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.739890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.740426 (+ 536us) server_negotiation.cc:407] Connection header received
0923 19:41:23.740659 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.740666 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.740769 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.740889 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.741792 (+ 903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43622: BlockingRecv error: recv got EOF from 127.0.0.1:43622 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260923 19:41:23.765185 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.762014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43632 (local address 127.12.159.253:40713)
0923 19:41:23.762226 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.762233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.763459 (+ 1226us) server_negotiation.cc:407] Connection header received
0923 19:41:23.763708 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.763717 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.763829 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.763960 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.764914 (+ 954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43632: BlockingRecv error: recv got EOF from 127.0.0.1:43632 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260923 19:41:23.805833 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.803367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43636 (local address 127.12.159.253:40713)
0923 19:41:23.803556 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.803562 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.804136 (+ 574us) server_negotiation.cc:407] Connection header received
0923 19:41:23.804379 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.804386 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.804498 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.804625 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.805513 (+ 888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43636: BlockingRecv error: recv got EOF from 127.0.0.1:43636 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260923 19:41:23.877912 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:23.875881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43648 (local address 127.12.159.253:40713)
0923 19:41:23.876113 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:23.876118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:23.876438 (+ 320us) server_negotiation.cc:407] Connection header received
0923 19:41:23.876661 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:23.876665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:23.876746 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:23.876838 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:23.877664 (+ 826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43648: BlockingRecv error: recv got EOF from 127.0.0.1:43648 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260923 19:41:24.013473 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:24.011469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43658 (local address 127.12.159.253:40713)
0923 19:41:24.011735 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:24.011742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:24.011979 (+ 237us) server_negotiation.cc:407] Connection header received
0923 19:41:24.012161 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:24.012165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:24.012256 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:24.012353 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:24.013183 (+ 830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43658: BlockingRecv error: recv got EOF from 127.0.0.1:43658 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
I20260923 19:41:24.257526 3490 catalog_manager.cc:1259] Loaded cluster ID: e9b80ccf8afc475aa6cdcef43f916685
I20260923 19:41:24.257638 3490 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: loading cluster ID for follower catalog manager: success
I20260923 19:41:24.260393 3490 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: acquiring CA information for follower catalog manager: success
I20260923 19:41:24.262388 3490 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2414fbade4ac42cf8926f0a23e3835bd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 19:41:24.275547 3400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:24.273951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43660 (local address 127.12.159.253:40713)
0923 19:41:24.274187 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:24.274192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:24.274406 (+ 214us) server_negotiation.cc:407] Connection header received
0923 19:41:24.274510 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:24.274514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:24.274589 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:24.274720 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:24.275379 (+ 659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43660: BlockingRecv error: recv got EOF from 127.0.0.1:43660 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260923 19:41:24.590418 3539 catalog_manager.cc:1259] Loaded cluster ID: e9b80ccf8afc475aa6cdcef43f916685
I20260923 19:41:24.590562 3539 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594: loading cluster ID for follower catalog manager: success
I20260923 19:41:24.593585 3539 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594: acquiring CA information for follower catalog manager: success
I20260923 19:41:24.596511 3539 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c5e00fedffd5486280539a3b86460594: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:41:24.812054 3605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:24.803921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43664 (local address 127.12.159.253:40713)
0923 19:41:24.804602 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:24.804609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:24.804921 (+ 312us) server_negotiation.cc:407] Connection header received
0923 19:41:24.805146 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:24.805151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:24.805308 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:24.805432 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:24.806061 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.807015 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.809148 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.809676 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.809792 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:24.810489 (+ 697us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:24.811298 (+ 809us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:24.811414 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:24.811573 (+ 159us) server_negotiation.cc:299] Negotiation successful
0923 19:41:24.811659 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":359,"threads_started":1}
I20260923 19:41:24.832618 3611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:24.818857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34458 (local address 127.12.159.252:38003)
0923 19:41:24.826285 (+ 7428us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:24.826296 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:24.826326 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:41:24.826453 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:24.826460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:24.826682 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:24.826907 (+ 225us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:24.827404 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.828545 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.829967 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.830613 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.830749 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:24.831265 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:24.831968 (+ 703us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:24.832133 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:24.832194 (+ 61us) server_negotiation.cc:299] Negotiation successful
0923 19:41:24.832287 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7277,"thread_start_us":7092,"threads_started":1}
I20260923 19:41:24.862906 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:24.839362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42854 (local address 127.12.159.254:33941)
0923 19:41:24.853248 (+ 13886us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:24.853254 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:24.853275 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:41:24.853406 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:24.853415 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:24.853690 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:24.853947 (+ 257us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:24.855147 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.856272 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.858867 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.859582 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.859727 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:24.860551 (+ 824us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:24.861560 (+ 1009us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:24.861780 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:24.862369 (+ 589us) server_negotiation.cc:299] Negotiation successful
0923 19:41:24.862470 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13752,"thread_start_us":14776,"threads_started":1}
I20260923 19:41:24.863158 3605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:24.839528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43676 (local address 127.12.159.253:40713)
0923 19:41:24.839724 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:24.839733 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:24.855352 (+ 15619us) server_negotiation.cc:407] Connection header received
0923 19:41:24.855798 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:24.855804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:24.855895 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:24.855959 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:24.856784 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.858092 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.860492 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.861222 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.861344 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:24.862226 (+ 882us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:24.862369 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:24.862437 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:24.862727 (+ 290us) server_negotiation.cc:299] Negotiation successful
0923 19:41:24.862814 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260923 19:41:24.863618 3611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:24.853023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34464 (local address 127.12.159.252:38003)
0923 19:41:24.853244 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:24.853253 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:24.855695 (+ 2442us) server_negotiation.cc:407] Connection header received
0923 19:41:24.856008 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:24.856014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:24.856124 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:24.856196 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:24.857164 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.858392 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.861130 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:24.861860 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:24.861965 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:24.862763 (+ 798us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:24.862918 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:24.862987 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:24.863222 (+ 235us) server_negotiation.cc:299] Negotiation successful
0923 19:41:24.863314 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:41:24.875926 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 3254
I20260923 19:41:24.877264 3316 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:24.994117 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 3254
I20260923 19:41:25.015321 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 3328
I20260923 19:41:25.016427 3390 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:25.123709 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 3328
I20260923 19:41:25.143859 12927 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu pid 3403
I20260923 19:41:25.144980 3465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:25.252357 12927 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWWieFZ/build/asan/bin/kudu with pid 3403
2026-09-23T19:41:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5040 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9596 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (367401 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST